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ABSTRACT 

A detailed description is presented of the types, 
functions, performance levels, governance, administration, and 
funding of public examinations in 14 Sub-Saharan African countries 
with different educational traditions, based on English, French, or 
other backgrounds. The countries are: (1) Kenya; (2) Lesotho; (3) 
Mauritius; (4) Svaziland; (5) Uganda; (6) Zambia; (7) Chad; (8) 
Guinea; (9) Madagascar; (10) Mauritania; (11) Rwanda; (12) Togo; (13) 
Cape Verde; and (14) Ethiopia. In virtually all of these countries, 
public examinations are offered at the end of primary (elementary) 
school, lower-secondary school, and upper-secondary school* 
Procedures for funding, constructing, administering, and scoring the 
examinations are discussed. Issues discussed include passing rates, 
the effects of examinations on teaching and grade repetition, the 
roles of assessment, implications of national policies, and ocher 
current international issues in education. Guidelines are offered for 
improving the quality of examinations and their uses. This synthesis 
report draws on a series of studies supported by the World Bank. 
Findings from the 14 studies confirm that public examinations may 
help raise academic standards, but can also cause many problems in an 
educational system. Nine tabler present data from the studies. A 
105-item list of references and three appendices with supplemental 
information are included. (SLD) 
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Foreword 



Public examinations tend to exert enor- 
mous influence on the nature of learning and 
teaching; they tend to dictate not only what 
is taught but also how it is taught In devel- 
oping countries, while most examinations 
serve a number of functions, including cer- 
tification and accountability, their main func- 
tion is to select students for the next highest 
level of the educational system. Their im- 
pact is most pronounced due to the short- 
age of places, particularly at the secondary 
and tertiary levels of formal schooling. 

This study presents for the ^irst time a 
detailed description of the types, functions, 
performance levels, governance, administra- 
tion, and funding of public examinations in 
a range of African countries with different 
educational traditions. The national public- 
examination systems of fourteen Sub- 
Saharan countries are reviewed. Six of the 
countries cie Anglophone (Kenya, Lesotho, 
Mauritius, Swaziland, Uganda, and Zambia) 
and six Francophone (Chad, Guinea, Mada- 
gascar, Mauritania, Rwanda, and Togo). The 
two remaining countries are Cape Verde and 
Ethiopia. Public examinations arc offered 
in virtually all of the countries at the end of 
primary, lower-secondary, and upper- 
secondary school. 

Procedures for funding examinations; for 
constructing, administering, and scoring 
papers; and for reporting results in each 



country are outlined in the report. Issues 
discussed include low pass rates, the back- 
wash effect that exanninations have on teach- 
ing and on grade repetition, ti^e roles of 
school-based and practical assessment, the 
implications of national language policies, 
the use of quotas and compensation proce- 
dures, the publication of national school 
rankings based on examination performance, 
and the low level of technical support avail- 
able to examination authorities. Guidelines 
are offered for improving ti^e quality of ex- 
aminations and for using examinations to 
improve education. 

Many current international issues in ti^e 
controversial topic of examinations and 
assessment are addressed. Thus, the study 
should be of interest to ministry of educa- 
tion officials, national exanrdnation bodies, 
development agencies, and national and in- 
ternational educational organizations. By 
offering concrete proposals for improving 
the quality of public examinations, and by 
focussing on the close interrelationship 
between formal assessment, teaching and 
learning, it helps pinpoint the way to rais- 
ing the level and the quality of education of 
pupils in Sub-Saharan Africa. 




Ismail Serageldin 
Director 

Technical Department 
Africa Region 



Preface 



The studies synthesized in this report 
originated from the emphasis on improve- 
ment in educational quality in the World 
Bank's policy paper. Education in Sub-Sa- 
haran Africa, published in January 1988. 
This emphasis was highlighted by twelve 
African Ministers of Education at the first 
plenary meeting of the Donors to African 
Education (DAE), established in the same 
month to support priority educational de- 
velopments. When the DAE Task Force met 
in June 1988, a Working Group on School 
Examinations (WGSE) was also established, 
in recognition of the important role exami- 
nations can play in quality improvement. 

The World Bank Education and Train- 
ing Division of the Africa Technical Depart- 
ment (AFTED), in assuming responsibility 
for developing appropriate activities to fur- 
ther quality improvement, then prepared 
terms of reference to undertake studies on 
examinations in primary and secondary edu- 
cation in Sub-Saharan Africa. The ni.?in ob- 
jectives of the studies may be sum:i\cjrized 
as follows: 

(1) to improve educational quality in a cost- 
effective way through adjustment of inputs 
relative to examination systems 

(2) to help develop institutional capacity in 
Sub-Saharan countries accordingly. 

Five studies (funded by the Bank's Eco- 
nomic Development Institute (EDI) and the 
Irish Government), completed in Fall 1988 
by the Educational Research Centre (ERG), 
Dublin, were discussed at a seminar on Us- 
ing Examinations and Standardized Testing 
to Improve Educational Quality in Lusaka, 
Zambia in November 1988. At this semi- 
nar, AFFED presented its terms of reference 



to deepen and extend the studies. Follow- 
ing consultation, fourteen countries agreed 
to participate in a set of studies under the 
terms of reference. Public examination sys- 
tems in six Anglophone countries (Kenya, 
Lesotho, Mauritius, Swaziland, Uganda, and 
Zambia), six Francophone countries (Chad, 
Guinea, Madagascar, Mauritania, Rwanda, 
and Togo) and two other countries (Cape 
Verde and Ethiopia) were investigated 

The studies were started in early 1989 
under AFTED management with Bank and 
Irish Government funding. Ireland agreed 
to act as lead donor, operating through the 
Irish Aid Agency, Higher Education for De- 
velopment Cooperation (HEDCO). An ini- 
tial model study was carried out in Swazi- 
land. Studies of examination systems in the 
six Anglophone countries and in Ethiopia 
were carried out under the direction of the 
ERG, Dublin; examination systems in Fran- 
cophone countries and in Cape Verde were 
studied by Management Planning and Re- 
search Consultants (MPRC), Bahrain. An 
important feature of these studies was the 
active participation of counterparts nomi- 
nated by Ministries of Education (MOE). In 
addition, lead donor Ireland hosted periodic 
meetings of the WGSE to advance the imple- 
mentation process. Progress reports were 
presented at DAE Task Force meetings. The 
findings of this synthesis report were dis- 
cussed at a November 1990 World Bank- 
sponsored seminar in Killiney, Dublin, at- 
tended by examination officials from each 
of the fourteen countries and representatives 
of donor agencies. 

This synthesis report is based on: (1) an 
analysis of existing examination systems; 
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(2) diagnosis of qualitative problems; and 

(3) assessment of existing institutional ca- 
pacity. The report draws also on research 
evidence from work undertaken in Western 
as v^ell as African countries to form an as- 
sessment of examination practice in Africa 
and to suggest guidelines for the construc- 
tion and administration of examinations that 
improve the quality of education. 
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Usi ig Examinations to Im.prove Education 
was managed by James McCabe, Principal 
Education Planner, Education and Training 
Division, Africa Technical Department of the 
World Bank. 
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following principal authors: 
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Acronyms for Public Examinations 
and Examination Authorities 



BEPC Brevet d'itudes du premier cycle. External examination taken at end of first cycle 
?:?condary (four years) in Togo, in Guinea, and in Chad. 

CHE r.iementary certificate, taken at the end of primary school, Mauritania. 

CEP Certificat defin d'itudes primaires. Primary-school leaving examination, Rwanda. 

CEPD Certificat de fin d'itudes de I'enseignement du premier degri External certificate 
examination at end of primary; also admission examination to secondary school, 
Togo. 

CEPE Certificat d' etudes primaires ilimentaires. External examination taken at end of 

primary school in Madagascar, Chad. 
CEPE A Certificat d'itudes primaires dimentaires. External examination taken at end of 

primary school in Chad, for Arabic-speaking students. 
CFE/FPl Certificat defin d'itudes de la formation professionnelle du niveau 1. External 

examination taken at end of first two-year vocational training period (Level I) in 
Madagascar. 

CFE/FP2 Certificat defin d'itudes de la formation professionnelle du niveau 2. External 

examination taken at end of second two-year vocational training period (Level 
II) in Madagascar. 

CFEPCES Certificat de fin d 'dudes du premier cycle de I 'enseignement secondaire. 

External examination taken at end of first cycle of secondary school in Madagas 
car. 

CPE Certificate of Primary Education, Mauritius. 

DEC Director of Examinations and Concours, Togo. 

ESLCE Ethiopian School Leaving Certificate Examination. 
HSC Higher School Certificate, Mauritius. 

KCPE Kenya Certificate of Primary Education, taken at the end of the eight-year 

primary cycle. 

KCSE Kenya Certificate of Secondary Education taken at the end of the four-year 

secondary cycle (introduced in 1989). 
KNEC Kenya National Examinations Council. 
MES Mauritius Examination Syndicate. 

PC Primary Certificate. 

PLE Primary Leaving Certificate. 

SC School Certificate, Mauritius. 

SEC Service of Examinations and Concours, Chad. 

UACE Uganda Advanced Ceritificate of Education. 
UCE Uganda Certificate of Education. 

UCLES University of Cambridge Local Examinations Syndicate. 
UNEB Uganda National Examinations Board. 
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1 Summary 



This Synthesis Report summarizes data 
and information from a set of studies un- 
dertaken in: 

(1) Kenya, Lesotho, Mauritius, Swazi- 
land, Uganda and Zambia; 

(2) Chad, Guinea, Madagascar, Mau- 
ritania, Rwanda, and Togo, and 

(3) Cape Verde and Ethiopia. 

It outlines the findings, issues and l ec- 
ommended improvements from the four- 
teen individual studies undertaken or pri- 
mary and secondary school examinations. 

Considerable reliance has been placed 
on public examinations in African educa- 
tion as a means of ensuring that teachers 
and students cover a common curriculum, 
and accordingly as a particularly effective 
instrument for raising academic standards. 
However, it has also been argued that while 
public examinations may help raise aca- 
demic standards, they may also give rise to 
problems in the educational system. The 
findings of the fourteen studies confirm this 
point. 

Findings 

Public examinations have three main 
functions: certification, selection and ac- 
countability. While most examinations 
serve all three to some extent, selection is 
undoubtedly the main function. The para- 
mount importance of selection is reflected 
in the large numbers each year who are not 
promoted to the next highest level of the 
educational system. There is also a grow- 
ing tendency to use a single examination 
for purposes of both selection and certifica- 
tion of level of attainment. 



Students in virtually all of the systems 
take public examinations at the end of pri- 
mary, first cycle secondary and second cycle 
secondary school. Candidates for primary- 
school leaving certificate examinations in 
most countries far exceed those taking sec- 
ondary school examinations. Countries in 
Francophone areas tend to require their stu- 
dents to take more formal examinations than 
those in Anglophone areas; most often they 
also offer term, end-of-year and concours 
(competitive selection) examinations. 

Setting of examinations seems a rather 
haphazard exercise, with some notable ex- 
ceptions. In some instances, a final selec- 
tion is simply made from a pool of ques- 
tions submitted by teachers. Most of the 
examinations reviewed show serious weak- 
nesses. Very little use is made of school- 
based assessment. 

Most scoring (or correction) of public ex- 
aminations is carried out by teachers, though 
a relatively small number of systems use op- 
tical scanning and/ or computer equipment. 
Two countries (Ethiopia and Swaziland) 
have had to abandon optical scanning. 

The important issue of marker reliability 
does not appear to have been addressed in 
most countries, though it should be, given 
the seriousness of the decisions made on the 
basis of examination performance. 

Pass rates tend to be low. In some in- 
stances the pass rate is determined by the 
number of places available at the next high- 
est level of schooling. Data on pass rates 
should be interpreted with caution. For ex- 
ample, quota systems are sometimes used 
to attain national objectives such as equality 
of male and female pass rates. Pass marks 
from region to region within countries may 



vary in an effort to ensure regional equality 
of opportunity. 

Public examinations undoubtedly exert 
enormous pressure on activities in schools. 
Teachers tend to gear teaching to the tests 
to be taken and to ignore material not fea- 
tured in such tests, even if it is mandated in 
the official curriculum. 

Most of the questions in public examina- 
tions tend to measure students' ability to 
recall facts. Relatively little attention is given 
to higher-order cognitive skills such as those 
involved in synthesis or evaluation. Exami- 
nation content tends also to be academic in 
nature; V j outside of school seldom features 
in examination questions. In most countries, 
particularly those of Francophone tradition, 
examinations are of the written essay or oral 
type. Other forms of assessment (multiple- 
choice, project, practical, or aural) are less 
frequently used. 

Whereas Ministries of Education admin- 
ister public examinations in Francophone 
countries, independent or semi-independent 
examination boards generally fulfil this func- 
tion in Anglophone countries. In a small 
number of countries, universities have re- 
sponsibility for the secondary-school leav- 
ing examination. 

For examinations run by Ministries of 
Education, fees are generally not charged at 
the primary level. However, Anglophone 
countries are more likely to charge fees. 
Most systems charge fees for secondary 
school leaving examinations; fees can be very 
high in some cases. 

Concern over security is a conspicuous 
feature of most systems. Legal provision for 
breaches of security vary. 

Examination results are seldom used to 
provide useful feedback to schools, admin- 
istrators or curriculum bodies. Thus, a good 
opportunity to effect change is little ex- 
ploited. 



Issues 

To date, not enough attention appears to 
have been focused on the educational con- 
sequences of existing examination systems. 
However, the likely impact of changing 
present systems needs to be studied care- 
fully, given the experience with public ex- 
amin .tions in non-African settings. 

It must be appreciated that however ex- 
cellent a test is in terms of validity, reliabil- 
ity, and efficiency, the pressure on students 
to perform will remain substantially un- 
changed while lack of places at the next high- 
est level persists. Where such bottlenecks ex- 
ist, it is naive to think that teachers will not 
attempt to gear teaching to testing, or that 
students will not seek outside help to enable 
them to advance to the next level. 

In this context also, it must be empha- 
sized that the high repetition rate attribut- 
able to "failure" may represent a serious 
waste of scarce educational resources. 

The need for definition and implemen- 
tation of language policies by governments 
is urgent, and in that regard, decisions are 
required on the most appropriate languages 
to be used in public examinations. In most 
countries the present emphasis on French 
and English has probably contributed to low 
pass rates. 

Clearly, practical subjects and school- 
based assessments will tend to receive little 
emphasis until they are incorporated into 
public examinations. These types of assess- 
ment, however, are time-consuming, expen- 
sive, and difficult to moderate. 

Efforts to localize (or nationalize) exami- 
nations, following long experience with sys- 
tems such as those offered by the Univer- 
sity of Cambridge Local Examination Syn- 
dicate, run the risk of undermining public 
confidence in the examination system. 
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likely impact of such tests on the vast ma- 
jority of students who may not proceed to 
the next highest level must be considered. 

Publication of school results and national 
rankings are designed to provide "incentive 
information/' a form of public accountabil- 
ity expected to motivate schools. Cogni- 
zance should also be taken, however, of the 
many factors (e.g., socio-economic) other 
than teaching effort and quality elements 
that affect examination performance. 

Efforts to modernize the processing of 
examination data should take into account 
the level of technical support available and 
particularly the extent to which foreign cur- 
rency is likely to be available for procure- 
ment of required equipment, materials, and 
expertise. 

Recommended Improvements 

It is clear that a public-examination sys- 
tem can exert a highly positive influence not 
only on the nature of assessment, but much 
more importantly on the nature of teaching 
and learning. While examinations cannot 
change the educational system, they can be 
made to reflect the objectives of curriculum 
developers and educational planners. The 
following recommendations are offered: 

1. Examinations should reflect the full cur- 
riculum, not merely a limited aspect of it. 

2. Higher-order cognitive skills should be 
assessed to ensure they are taught. 

3. Skills to be tested should not be lim- 
ited to academic areas but should also be 
relevant to out-of-school tasks, 

4. A variety of examination formats 
should be used, including written, oral, au- 
ral, and practical. 

5. In evaluating published examination 
results and national rankings, account 



should be taken of factors other than teach- 
ing effort. 

6. The number of public examinations 
should be reduced to help diminish repeti- 
tion and dropout rates and the inevitable 
sense of failure experienced by students. 

7. The amount of time teachers spend on 
testing and preparing for public examina- 
tions should be lessened to provide more 
time for teaching. 

8. Detailed, timely feedback should be 
provided to schools on levels of pupil per- 
formance and areas of difficulty in public 
examinations. 

9. Predictive validity studies of public ex- 
aminations should be conducted. 

10. The professional competence of exami- 
nation authorities needs to be developed, es- 
pecially in test construction. 

1 1 . Each examination board should have a 
research capacity. 

12. Examination authorities should work 
closely with curriculum organizations and 
with educational administrators. 

13. Regional professional networks should 
be developed to initiate exchange programs 
and share common interests and concerns. 
An example is the Association of Heads of 
Institutions Responsible for Examinations 
and Education Assessment in East and 
Southern Africa. 

14. A post-graduate degree course should 
be established in an African country for ex- 
amination authority personnel. 

Finally, while implementation of the 
above can effect improvement, it should be 
recognized that other factors such as avail- 
ability of places, language of instruction and 
assessment, amount and quality of literacy 
materials and quality of teaching, together 
with examinations, will play critical roles in 
improving the quality of education. 
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2 The Need for Reform in African Education 



After a period of massive expansion, edu- 
cation in many African countries has, dur- 
ing the last decade, encountered a series of 
problems. While demand remains high, 
progress towards universal provision at the 
primary level and expansion at the second- 
ary level has slowed, mainly because of a 
shortage of money. More limited financial 
resources than had been available in the past 
are being spread more thinly over increas- 
ing numbers of students (Fuller 1986; World 
Bank 1988). Given this situation, the choice 
for policymakers, for at least the remainder 
of this century, would appear to lie either in 
increased efficiency in the use of existing 
resources or in the acceptance of declining 
standards of access, equity, and scholastic 
achievement (Windham 1986). 

In this chapter, we outline some current 
concerns about education in Africa. Pro- 
posals to address these concerns relate to a 
variety of actions — the provision of books 
and equipment, teacher training, enlisting 
the support of children's homes, and im- 
proving the nutritional status of children. 
Our concern is with the possible role of 
public examinations, a well-established fea- 
ture of African educational systems, in im- 
proving educational achievement. 

Growth in Education 

Africa has the lowest primary, second- 
ary, and university enrollment rates of any 
world region (Nafziger 1988). This is so 
despite the fact that educational systems 
throughout the continent expanded rapidly 
in the 1960s and 1970s. For example, be- 



tween 1960 and 1983, the number of pri- 
mary-school pupils in Sub-Saharan Africa 
increased by well over 400 percent, from 
11.85 to 51.35 million. Gross enrollment ra- 
tio over the same period rose from 36 to 75 
percent (World Bank 1988). At secondary 
level, the increase, at 1,400 percent, was even 
greater. Student numbers rose from .79 to 
11.12 million and gross enrollment ratio from 
3 to 20 percent (World Bank 1988). 

Despite massive expansion, the discrep- 
ancy between provision at primary and sec- 
ondary levels remained great. The percent- 
age of students in Sub-Saharan countries 
who transferred from the last grade of pri- 
mary school to the first grade of secondary 
general education in 1983 was 43 (World 
Bank 1988). This figure has a particular 
relevance to examinations because they are 
used to control the flow of students at this 
juncture, as well as at other points, in the 
educational system. The success or failure 
of a student at any of the important selec- 
tion points in the system can have very se- 
rious consequences for his or her educational 
and occupational future. It is precisely be- 
cause of their role as gatekeepers in educa- 
tional systems, in that the number of places 
diminishes as one ascends the educational 
hierarchy, that examinations have acquired 
the importance they possess in African coun- 
tries. 

Educational growth in Africa has slowed, 
and in some countries has stagnated or ac- 
tually declined, in recent years. This has 
been attributed largely to poor economic 
conditions that were aggravated, in the first 
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instance, by the oil crisis in the 1970s and, 
more recently, by increasing levels of debt- 
repayment obligations (Windham 1986). To- 
tal public expenditure on education in Af- 
rica declined from $10 billion in 1980 to $8.9 
billion in 1983, while per-pupil expenditure, 
both in absolute terms and as a proportion 
of gross national product, declined mark- 
edly at both primary and secondary levels 
(World Bank 1988V 

There are a number of reasons why the 
educational systems of Africa are particu- 
larly vulnerable to economic circumstances 
and the conditions of government finances. 
First, the role of the public sector in financ- 
ing education is a majo'" one. In 1983, for 
example, 85.4 percent of primary students 
and 85.1 percent of secondary students were 
in public schools. The proportion for Fran- 
cophone countries was larger than for An- 
glophone countries (World Bank 1988). 
Second, state subsidies are large, as fees for 
public education recover only 5.7 percent of 
the cost of primary education, 11.4 percent 
of the cost of secondary education, and 1.9 
percent of the cost of higher education. 
Third, because of the low level of gross 
national product (GNP) in many African 
countries, the cost of public education for 
one student as a percentage of per capita 
GNP is higher in Africa than in any other 
region (Mingat and Psacharopoulos 1985; 
Nafziger 1988; Unesco 1990, Table 19). 

Although resources are limited, and even 
diminishing, school-age populations are in- 
creasing rapidly. During the past twenty 
years, over 50 million new pupils enrolled 
in school throughout the continent, and it is 
expected that the number that will become 
eligible in the next twenty years will be 110 
million (Windham 1986). In addition, the 
demand for educated manpower to support 
economic growth is likely to grow, putting 
pressure on governments to expand educa- 
tional facilities. Moreover, many countries 
made commitments following independence 
to provide education for social as well as 



for economic reasons (see, for example, 
Swaziland, Ministry of Education 1986; Tan 
1985; Zambia, Ministry of Education 1977). 
Attempts to meet these commitments can 
be expected to contribute to the growth in 
numbers attending school. 

Concern with Quality 

Side by side with the problems of de- 
creased financial resources and stagnating 
enrollments, commentators in a number of 
African countries, as in countries elsewhere 
throughout the world (see Heyneman and 
White 1986), have expressed concern about 
a decline in quality of the education being 
offered in schools (see, for example. Evalu- 
ation Research of the General Education 
System in Ethiopia - ERGESE, 1986; Kelly 
1991; Zambia, Ministry of Education 1977). 
Although many countries now collect edu- 
cational statistics, for example on participa- 
tion rates, on a fairly routine basis, evidence 
relating to the quality of provision or of 
output is more difficult to come by. There 
is some evidence of decline in the quality of 
provision. Supplies of key inputs, especially 
books and other learning materials, are re- 
ported to be critically low in many coun- 
tries (World Bank 1988). Concern has also 
been expressed about decline in quali'- 
output (as measured, for example, b_ 
dent achievement). Such concern is l u ,. a 
for the most part on impressionistic evi- 
dence, evidence, of course, that should not 
be ignored. The available empirical evi- 
dence on a decline in standards, however, 
is far from satisfactory. While the Interna- 
tional Association of the Evaluation of 
Eduactional Achievement (TEA) studies of 
achievement in mathematics in Nigeria and 
Swaziland have been cited as evidence of 
declining standards (World Bank 1988, p. 
33), these studies do not tell us anything 
about change as they were carried out on 
only one occasion. 

Examination performance over time is a 
possible source of evidence regarding chang- 
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ing standards (see Kahn 1990). However, 
the characteristics of students taking an ex- 
amination as well as the standard required 
to achieve a particular grade in an examina- 
tion, particularly if a predetermined propor- 
tion of students is assigned to each grade, 
may vary from year to year. Thus, knowl- 
edge of the numbers achieving particular 
grades over time does not permit unambigu- 
ous inferences about changes in standards. 
It is worth noting, however, that in Swazi- 
land, pass rates increased on the Cambridge 
Overseas School Certificate (that was con- 
trolled by the Cambridge Syndicate) from 
36 percent in 1980 to 54 percent in 1988. 
There was an even greater increase in the 
percentage of first and second-class passes. 
It is of interest, in the context of the present 
report, that the improvements have been at- 
tributed to strategies (that were implemented 
between 1984 and 1987) designed to increase 
the competence of inspectors and teachers 
in the assessment of students (Lulsegged 
1988). It is also of interest that the nature of 
student assessment in Swaziland/ even be- 
fore the efforts to improve it, may have dif- 
fered from that in other countries. An analy- 
sis of lEA data, that were collected in Nige- 
ria and Swaziland in 1980-81, indicates that 
time spent by teachers in monitoring and 
evaluating student performance was posi- 
tively associated with achievement in Swazi- 
land but not in Nigeria (Lockheed and 
Komenan 1989). The Swazi data, however 
one interprets them, do seem to contradict 
the general perception of declining standards 
of achievement in African schools, under- 
lining the need for more systematic empiri- 
cal evidence relating to standards of achieve- 
ment over time. 

Strategies to Improve Education 

Because of the perceived need in many 
countries not just to maintain standards of 
access, equity, and academic achievement 
but to improve them, a number of strategies 
have been considered for educational reform 
(see Fuller 1986; Fuller and Heyneman 1989; 



Hallak 1990; Heyneman 1985, 1987; Mingat 
and Psacharopoulos 1985). The World Bank 
(1988) has shown a particular interest in this 
problem and has identified three major ar- 
eas to be considered in the formulation of 
policy: 

(1) Adjustment to current demographic and 
fiscal realities, that will require: (a) diversi- 
fication of sources of finance (in the form of 
increased cost sharing in public education 
and encouragement of nongovernmental 
suppliers of educational services); and (b) 
unit-cost containment, that will be of greater 
importance than cost sharing in countries in 
thiat the scope for cost sharing is negligible 
or non-existent. One aspect of the organiza- 
tion of education that could contribute to 
unit-cost containment would be a reduction 
in the amount of grade repetition. 

(2) Revitalization of the existing educational 
infrastructure, that will include: (a) a re- 
newed commitment to academic standards 
(principally by strengthening examination 
systems); (b) restoration of an efficient mix 
of inputs in education (especially increasing 
the amount of textbooks and other learning 
materials); and (c) greater investment in the 
operation and maintenance of physical plant. 

(3) Selective expansion, that will be viable 
only after measures of adjustment and re- 
vitalization have begun to take hold and 
will involve: (a) renewed progress towards 
the long-term goal of universal primary 
education; (b) the development of alterna- 
tive ways of delivering educational services 
(including distance education); (c) training 
for those who have entered the work force 
in job-related skills; and (d) research and 
postgraduate education. 

In a document adopted by the World 
Conference on Education for All, that was 
convened jointly by the executive heads of 
the United Nation's Children's Fund 
(UNICEF), United Nations Development 
Programme (UNDP), Unesco, and the World 



Bank; and was held in Jomtien, Thailand, 
from March 5 to 9, 1990, the emphasis on 
basic education and the achievements of stu- 
dents who receive that education is again 
evident. Article 3 of the World Declaration 
on Education for All (1990) states that "Basic 
education should be provided to all children, 
youth and adults" (p. 4). Recognizing that 
the provision of such education is only 
n^eaningful if people actually acquire useful 
knowledge, reasoning ability, skills, and 
values. Article 4 of the Declaration states that 
the focus of basic education must be "on 
actual learning acquisition and outcome, 
rather than exclusively upon enrolment, 
continued participation in organized pro- 
grams and completion of certification re- 
quirements" (p. 5). 

Examinations and Reform 

The idea that examinations may have an 
important role to play in effecting a reform 
in education in developing countries arises 
from the belief that they exercise a strong 
influence on what is taught in schools and 
can be used as instruments of accountabil- 
ity. It can also be argued that they provide 
a relatively simple means of controlling a 
system in that resources for other means of 
control, such as school inspection and 
teacher training, are limited and in that stu- 
dents attend private schools and non-formal 
educational establishments as well as pub- 
lic schools. 

Effects of Examinations on Curricula 

What evidence do we have that exami- 
nations affect curricula and teaching in 
schools? Perhaps the most striking example 
of how an assessm.ent procedure can affect 
the content and skills covere 1 in a curricu- 
lum is to be found in an anecdote of a per- 
son who carried out research on the selec- 
tion and training of U.S. naval personnel 
during the second World War (Fredericksen 
1984).' Tliis person found that the best tests 
for predicting grades given by instructors 



were written verbal and reading comprehen- 
sion tests. This did not seem to make much 
sense given the tasks that guimers were sup- 
posed to do, such as maintaining, adjusting, 
and repairing guns. On examining what 
went on in training, the researcher found 
that classes consisted of lecturing and dem- 
onstrating how to use equipment, rather 
than having students do the actual tasks 
themselves. He then designed performance 
tests in that students were required to dem- 
onstrate competence by, for example, remov- 
ing and replacing the extractor plunger on a 
5 /38-inch anti-aircraft gun. Few of the stu- 
dents could perform the tasks. 

New students soon found out what the 
new performance tests were like and began 
practicing the assembly and disassembly of 
guns. The instructors also moved from lec- 
turing to more practical work with guns and 
gun mounts. At the end of the course, stu- 
dents performed very much better on the 
performance tests than students who had 
experienced the older instructional method. 
Further, the predictive validity of the verbal 
and reading tests dropped while the valid- 
ity of the mechanical aptitude and mechani- 
cal knowledge tests improved. 

The interesting point of this anecdote is 
that no attempt was made to change the cur- 
riculum or teacher behavior. The dramatic 
changes in curriculum and achievement came 
about solely through a change in testing. 

In the day-to-day workings of schools, 
the effects of assessment on curricula and 
on sti.ident achievement are not so dramatic. 
However, there can be little doubt that ex- 
aminations, to which high stakes are at- 
tached, exert considerable influence on what 
goes on in schools (Fredericksen 1984; 
Madaus and Kellaghan, in press). Those 
involved in an educational system that has 
such examinations will attest to the fact that 
the topics that teachers and students attend 
to in class and in study are the topics that 
are likely to appear on examination papers. 
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One commentator has concluded that since 
examinations represent "the ultimate goal 
of the educational career, they define what 
are the important aspects of a school cur- 
riculum and they dictate to a large degree 
the quality of the school experience for both 
teacher and student alike" (Little 1982). 

If the examinations are good, this might 
be a satisfactory situation. If the objectives 
and skills to be measured are carefully cho- 
sen and if the tests truly measure them, then 
the goals of instruction will become explicit 
and well-defined targets for teachers and 
students on that they can focus their efforts. 
Furthermore, the examinations will provide 
students and teachers with standards of ex- 
pected achievement. Given this situation, 
there should be no reason why students 
should not work for marks, and good rea- 
sons why they should ( Fredericksen 1984). 
In practice, however, examinations may lack 
"construct validity" or, for other reasons, 
may not meet the high standards that would 
justify teachers and students devoting their 
efforts to performing well on them. 

Quality of Examinations 

Evidence from many countries through- 
out the world over the past century sug- 
gests that public examinations suffer from a 
variety of defects (Madaus and Kellaghan, 
in press). In African countries, defects of 
examinations have been pointed out on nu- 
merous occasions, in both offici.il and unof- 
ficial reports. First, most examinations, at 
both primary and secondary level, are lim- 
ited to pencil-and-paper tests and so ignore 
a variety of skills that cannot be measured 
in this way. Second, examinations empha- 
size the achievement of scholastic skills (par- 
ticularly language and mathematics at the 
end of primary schooling) paying very little 
attention to more practical skills. Third, in 
most examination questions, the student is 
required to recall or recognize factual knowl- 
edge, rather than to synthesize material or 
apply principles to new situations. Fourth, 



many examinations contain very little refer- 
ence to the everyday life of students outside 
the school, dealing with scholastic topics and 
applications for the most part, rather than, 
for example, trying to find out if a student 
can use money in the market place. Fifth, 
the quality of actual items used in tests is 
often poor (see Cambridge Educational Con- 
sultants 1988; ERGESE 1986; Kelly 1991: 
Lesotho 1982; Little 1982; Myeni 1985; 
Oxenham 1983). 

If schools gear their teaching to such 
examinations, then they are unlikely to be 
Vi successful in developing in their 
students the kind of knowledge and skills 
that most people would regard as 
desirable — skills of observation, problem 
identification, problem-solving and 
reasoning, and particularly knowledge and 
skills that can be applied in the day-to-day 
life of the many students who will have only 
minimal exposure to formal education (see 
National Commission on Testing and Public 
Policy - NCTPP, 1990; Nigam 1982). Rather, 
the effect of such examinations, as was 
observed in Ghana, is likely to be "to support 
and encourage rote-memorization, routine 
drilling, bookishness" (Brooke and 
Oxenham 1984, p. 158). Indeed, the view 
was expressed in a government report in 
Lesotho (1982) that many problems with 
curriculum and instruction seem to stem 
from 

... .the inordinate emphasis given 
to the preparation for terminal 
examinations which undermines the 
attainment of certain objectives that 
are critical to the country's economic 
development. . . 

The JC [Junior Certificate] 
examination heavily emphasizes the 
accumulation of factual knowledge 
and neglects general reasoning skills 
and problem-solving activities" (p. 
94). 

In Ghana, Brooke and Oxenham (1984) 
have noted that teachers tend to neglect non- 
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examination subjects even though the offi- 
cial timetable might require that allocation 
of time be adhered to strictiy. Teachers even 
pick topics within subjects according to 
whether they judge them as likely or not to 
appear in examinations. The same phenom- 
enon has been observed in Uganda, where 
neglect of the teaching of practical skills, es- 
pecially at the primary level, and the conse- 
quences of this for students on leaving 
school have been noted (Uganda, Ministry 
of Education 1989). In such situations, the 
effect of examinations can be inhibiting, serv- 
ing to distort or prevent learning rather than 
to promote or facilitate it (Heyneman and 
Ransom 1990; Little 1990). 

The use of examinations that were set 
and marked outside of African countries 
probably contributed to the perpetuation of 
the situation in that examinations took little 
cognizance of the conditions in that students 
lived and were likely o live in the future 
(Kellaghan 1991). As late as 1981, the school- 
leaving certificate examinations in seven 
African countries were set and marked by 
the University of Cambridge Local Exami- 
nations Syndicate (Bray, Clarke, and 
Stephens 1986), a situation that has now 
changed. Since preparation for examinations 
was important in schools, we might expect 
that the examinations contributed signifi- 
cantly towards the maintenance of a west- 
ern academic education. The examinations 
also, of course, contributed to the mainte- 
nance of standards and acceptance of certi- 
fication at the international level, important 
considerations in developing countries. 

The setting up of local examination 
boards did not result in a sudden break with 
the traditions of the colonial system in the 
content of curricula or examinations or in 
modes of examining. For example, the West 
African Examinations Council was set up in 
1951 to serve the Gambia, the Gold Coast, 
Sierra Leone, Nigeria, and later Liberia, as a 
local independent body. However, in its 
1980 Advanced-level English Literature syl- 



labus, only six of 39 authors named were 
African, and only three of these were West 
African. As well as studying Shakespeare, 
students had the option to study the poetry 
of Chaucer, John Donne, and George 
Herbert. The Senegalese Baccalaureat of- 
fered examinations in ten languages, none 
of them African (Bray, Clarke, and Stephens 
1986). 

While examinations at the primary level 
are controlled locally in all countries, for- 
eign influences are to be found in curricula 
and examinations at this level also. In a 
study of the national primary-certificate ex- 
aminations of ten Anglophone countries, 
Hawes (1979) found that, in 1978, five used 
only the English language, a further four 
used English in all papers except in the one 
examining the local language, and only one 
used a local language as the main examin- 
ing language. Reliance on English in these 
cases invariably reflects the fact that there 
are several, in some cases a great many, local 
languages, none of that is spoken through- 
out the country. In linguistically heteroge- 
neous situations, learning and being exam- 
ined in a metropolitan language is perceived 
to favor no particular group. Furthermore, 
the use of metropolitan languages, such as 
English and French, is seen as conferring 
benefits, particularly on those who are likely 
to proceed to third-level education (Eisemon 
1990). However, the advisability of teach- 
ing and examining through English or 
French students who have poor proficiency 
in the language and who rarely if ever use 
the language outside school is something 
that has been questioned many times. Stu- 
dents with limited knowledge of a language 
will inevitably be handicapped in the ac- 
quisition of knowledge and skills presented 
in the language as well as in their ability to 
demonstrate in examinations the knowledge 
and skills they have acquired (Eisemon 
1990). 

A further problem with many external- 
examination systems in Africa is that their 



primary use is to control the flow of stu- 
dents through the educational system. This 
use is understandable, and the selection 
function of examinations will no doubt con- 
tinue to be important as long as there is a 
shortage of places at higher levels of educa- 
tional systems. However, there are a num- 
ber of dangers inherent in focussing on the 
use of examinations for selection. First, the 
examinations will tend to be geared to the 
needs of pupils who are doing relatively well 
in the system while the needs of lower 
achieving students may not be adequately 
met. And, second, it is likely that the ex- 
aminations will focus on academic topics. 
In the early 1970s, the ILO (1972), in a com- 
ment that could have been applied to the 
educational systems of many African coun- 
tries, noted that, in Kenya, most primary cur- 
ricula and examinations ignored the needs 
of terminating students. 

To help avoid such undesirable effects 
in constructing examinations, it is important 
to keep clearly in mind the need for certify- 
ing the achievements of all students, as well 
as the need for selection. Further, cognizance 
should be taken of the motivational effect of 
examinations on students and the influence 
of examinations on what is taught and em- 
phasized in schools. Examinations that are 
designed for only the top 20, 30, or even 50 
percent of students and the curricula that 
prepare students for such examinations are 
likely to be seen as irrelevant to lower- 
achieving students. 

Role of Examinations in Reform 

Given the importance of public exami- 
nations in educational systems, to an extent 
th'.t a school's success may be "judged 
sL icUy by the performance of its students in 
the examinations" (Fafunwa 1974, p. 193), it 
is not surprising that the role of examina- 
tions has received particular attention in the 
context of the problems facing education in 
Africa today. For some observers, external 
public examinations are perceived as con- 



tributing to the problems, while others see a 
role for examinations as part of a possible 
solution. Those who perceive examinations 
as part of the problem cite the evidence 
considered above concerning the inadequacy 
of examinations. If examinations serve to 
distort or prevent desirable learning, it might 
not seem unreasonable to conclude that 
public examinations should be abolished. 
Together with this view, it is usually pro- 
posed that a system of school-based assess- 
ment should be installed in place of exter- 
nal examinations. 

An alternative view is that since there is 
a lack of the resources that would be needed 
to introduce alternative assessment proce- 
dures, for example school-based assessment, 
to the educational systems of most African 
countries and since the need for selection 
will continue in the foreseeable future, it 
would appear to be unrealistic to talk of dis- 
pensing with present examination systems. 
This view also recognizes that examination 
systems in Africa are perceived by many to 
be relatively fair and impartial and that they 
also serve to legitimate the allocation of 
scarce educational benefits. Before an alter- 
native system could be introduced, it would 
be necessary to demonstrate that it could 
fulfil this task equally well. It is also ar- 
gued that examinations, if properly de- 
signed, could have a beneficial effect on the 
quality of education in schools. Because of 
the high stakes associated with examinations 
in terms of student opportunities and teacher 
accountability, changes in examinations 
would most likely be reflected in changes in 
educational practice in schools. If the 
changes involve improving the quality and 
scope of examinations, these in turn should 
result in improving the educational experi- 
ences of students in schools (Heyneman 
1987; Heyneman and White 1986; 
McNamara 1982). In Little's (1984) words, 
examination improvements could help turn 
the educational system into one "which en- 
courages, rather than stultifies, desirable out- 
comes" (p. 228). Again, Little (1982) argues 



that "the quality of the examination system 
itself can have a considerable impact on the 
quality of skill formation encouraged by the 
education system, that skills in turn could 
have a considerable impact on the inputs to 
the labor market" (p. 177). 

The possible role of examinations in edu- 
cational reform has been considered in a 
number of policy documents. In the World 
Bank (1988) strategies outlined above, the 
need to strengthen examination systems in 
the interest of raising academic standards is 
specifically mentioned in the context of re- 
vitalizing the existing educational infrastruc- 
ture. Further, examination and assessment 
systems could be rationalized and made 
more efficient; this seems important at a time 
when numbers taking examinations are 
showing Irrge increases in many countries. 
Again, assessment procedures could be used 
in a formative way to guide instructional 
and learning processes in schools to reduce 
dropout rates and grade repetition. In their 
important role in educational selection, ex- 
aminations could contribute to greater effi- 
ciency in the educational system by identi- 
fying students most likely to benefit from 
further education. Finally, in future expan- 
sion of educational systems, examination 
and assessment procedures could be as- 
signed an important role in the provision of 
feedback information to schools on student 
achievement levels. They could also have 
an important role in ensuring comparability 
of standards between school-based and non- 
school-based candidates, if non-school-based 
ways of delivering educational services are 
developed further. 

The fact that systems of examinations and 
assessment can be used for a variety of pur- 
poses should not be taken to imply that a 
single system of examinations or assessment 
can readily serve all purposes equally well. 
For example, an examination system that ef- 
ficiently selects the pupils most likely to ben- 
efit from further education might contrib- 
ute to the identification of a technical elite 



and over time might even have important 
effects on the economic performance of a 
nation (Heyneman 1987). However, sud\ a 
system could have serious and damaging 
effects on the educational experiences of 
many students if it ignores the fact that for 
many students— in fact the majority—learn- 
ing has to have utility beyond that of quali- 
fying individuals for the next level of edu- 
cation (World Bank 1988). Thus, a procedure 
that most efficiently selects students may be 
inadequate for certification purposes. Simi- 
larly, a procedure that is adequate for certi- 
fication is unlikely to be the most appropri- 
ate one for monitoring the quality of perfor- 
mance of a school or of the educational sys- 
tem in general. 

In considering examination reform, it is 
important to bear in mind the different func- 
tions of examinations and the many possible 
effects of examination systems on schools, 
teaching, and learning. It is also important 
to realize that in selecting the specific inno- 
vations most likely to fulfill a country's re- 
quirements, insofar as is possible, effects 
should be anticipated and judged as desir- 
able or undesirable in the context of the 
general goals and aims of each country's 
own educational system (Eckstein and Noah 
1988; Heyneman 1987). We shall return to 
these issues in Chapter 5. 

Efforts to reform curricula and examina- 
tions are already in evidence in a number of 
countries. For example, a program of cur- 
riculum reform has been carried out in Le- 
sotho. Syllabi in the core subjects (Sesotho, 
English, Science, Mathematics, Social Stud- 
ies) have been designed and disseminated. 
Syllabi comprise units, specific objectives, 
suggested activities, skills and concepts to 
be learned by students, and resource mate- 
rials. Side by side with these activities, skills 
checklists for Sesotho, English, and Math- 
ematics (Standards 1-3) and sample test 
question booklets in English and Mathemat- 
ics (Standards 4-6) have been constructed to 
reflect the new curricula. 
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Initiatives in Kerj^a have been more ob- 
viously directed towards the use of exami- 
nations to improve the quality of learning 
in schools. In these initiatives, that have 
been reported by Somerset (1987, 1988), the 
content of the public examinations at the end 
of primary schooling was changed and a sys- 
tem to provide feedback information to the 
public and to schools was introduced. The 
reform in the content of examinations in- 
volved the inclusion of a much broader spec- 
trum of cognitive skills than had previously 
been included in examinations, skills de- 
signed to measure comprehension and ap- 
plication, as well as skills that could be ap- 
plied in a wide range of contexts, in and out 
of school. This was done in recognition of 
the fact that examinations should not be con- 
fined to the measurement of students' abil- 
ity to memorize factual information but 
should also promote the teaching and learn- 
ing of competencies that would be useful 
not only to those who stay in school but 
also to the majority who would leave after 
the examination. Little (1984) has described 
the changes between 1971 and 1979 in the 
distribution of items designed to test knowl- 
edge, comprehension, and application in the 
Certificate of Primary Education in Kenya 
as "dramatic." 

In the feedback system in Kenya, lists of 
schools were published that reported the 
overall mean of the performance of students 
in each school on the examination. Mean 
standard scores for each district in the coun- 
try were abo published. This was described 
as "incentive information." "Guidance in- 
formation," based on an analysis of the per- 
formance of students nationally on indi- 
vidual questions, was also provided in a 
newsletter that was sent to schools. The 
newsletter explained changes in the content 
and skills covered in examinations, identi- 
fied topics and skills causing problems, and 
suggested ways of teaching these topics and 
skills. The incentive information was first 
published following the 1976 primary-school 



certificate examination although the infor- 
mation did not receive wide publicity until 
after the 1978 examination. The first full- 
length newsletter was based on the 1978 ex- 
amination results. 

Oiily limited information is available re- 
garding the impact of these procedures on 
school practice or student achievement. At 
the time he prepared his report, Somerset 
(1987) indicated that relevant data on teach- 
ing methods and content had not been col- 
lected. He did, however, provide informa- 
tion on changes in the relative mean scores 
of districts throughout the country between 
1976 and 1981. He attributed changes in 
these scores between 1976 and 1979 mainly 
to the impact of the incentive feedback sys- 
tem. If that is correct, then the impact was 
negative since mean performances between 
districts, that it had been hoped would nar- 
row, substantially widened during the pe- 
riod. In the following two years, during 
v/hich guidance information was available, 
the trend was reversed and some districts 
in which mean scores had been relatively 
low improved their positions. It may be 
that guidance information contributed to this 
improvement, but any firm conclusions 
about the effects of any of the changes in 
the examinations system are not possible on 
the basis of the available information. 

Since students' test performances on the 
primary-certificate examination each year 
were converted to standard scores derived 
from a distribution with a mean of 50 and a 
standard deviation of 15, inferences cannot 
be drawn about possible trends in student 
achievement over time. Yussufu (1989), how- 
ever, has stated that the performance of can- 
didates on the Kenya Certificate of Primary 
Education Examination (KCPE), first intro- 
duced in 1985, "has, in general terms, shown 
a steady consistent improvement." This con- 
clusion is presumably based on changes in 
students' raw scores. Information about the 
nature or extent of the changes, however, is 
not provided. 
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Neither is information available on other 
possible effects of the examination and re- 
porting systems, though we might expect 
effects on, for example, retention, repetition, 
and dropout rates in schools. 

Eisemon, Patel, and Abagi (1987) observe 
that the introduction of new question items 
on the primary-school leaving examination 
in Kenya has not, in their opinion, changed 
primary-school instruction "in ways in 
which greater emphasis on problem solv- 
ing, reasoning and explanation can be dis- 
cerned." They stress the need to build ex- 
aminations in accordance with cognitive 
theories of the measurement of achievement 
if the examinations are to have a beneficial 
effect on school practice. They studied the 
impact of examinations that had been con- 
structed in accordance wifh. such a theory 
on instruction and learning in a Nairobi pri- 
mary school. The study is limited in its 
scope in a number of respects: it is confined 
to one school; it deals only with health edu- 
cation; and it was carried out under experi- 
mental conditions. Thus the findings might 
not apply in the normal circumstances u: 
der which examinations are administered. 
In some instances examination items assess 
pupils' abilities to integrate existing and new 
knowledge. These items are explicitly related 
to the competent performance of target be- 
haviors. Because of this deliberate structur- 
ing of items, teachers' explanatory behav- 
iors and their emphasis on procedures to 
foster pupil understanding will improve. 
On the basis of this study and of their con- 
sideration of reform efforts in Kenyan edu- 
cation, Eisemon and others (1987) conclude 
that: 

Psychometric manipulation of exami- 
nation items in the absence of more 
research into instructional and cogni- 
tive processes may produce better 
<^ests and different teaching, but this 



will not necessarily make schools any 
more effective especially insofar as 
fostering outcomes like better health 
are concerned. 

How precisely examinations might con- 
tribute to the improvement of education in 
ways that everyone regards as desirable is 
not clear. Is it, for example, necessary to 
build tests in accordance with cognitive theo- 
ries of the measurement of achievement, as 
Eisemon and others suggest? While such an 
approach might be helpful, though its limi- 
tations must also be recognized in light of 
our poor understanding of the process of 
achievement measurement, it would hardly 
seem to be necessary. Insofar as we know, 
no such theories guided the work of the 
person involved in the measurement of the 
performance of the young navy personnel 
in Fredericksen's study (1984), described 
above. Even if construction of a test along 
certain principles is more likely to assist in 
student learning than a test that does not 
follow those principles, we know very little 
about the mechanism that can translate ex- 
perience of examinations and knowledge of 
results (that might be in the heads of stu- 
dents, teachers, parents, or administrators) 
into higher student academic achievement. 
So iong as that is so, we should be circum- 
spect in our recommendations about the use 
of examinations in the interest of raising 
student achievement. Actions based on de- 
cisions taken on an a priori basis, and with- 
out the beneJt of conceptual analysis and 
empirical evidence, run the risk of being at 
best ineffective and at worst damaging. Be- 
cause of this, we emphasize the need to con- 
sider possible problems and undesirable ef- 
fects that can arise when examinations are 
used to direct the activities of teachers and 
students. We consider these problems in 
Chapter 5 after we set out guidelines relat- 
ing to the improvement of examinations. 
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3 The Educational Systems of Fourteen Countries 



Countries in lire Study 

In this report, we are concerned with the 
examination systems of fourteen African 
countries. While many of these countries 
experienced a variety of colonizers (Arab, 
Belgian, British, French, German, Italian, and 
Portuguese), they are sometimes categorized 
in terms of the European language that in 
addition to local languages, is used in the 
country today. Using this criterion, six of 
the countries can be described as Anglo- 
phone (Kenya, Lesotho, Mauritius, Swazi- 
land, Uganda, and Zambia); six as Franco- 
phone (Chad, Guinea, Madagascar, Mauri- 
tania, Rwanda, and Togo); while two fall 
into neither of these categories (Cape Verde, 
Ethiopia). 

At the outset, it has io be recognized that 
great variation exists among (and often 
within) the countries that were studied for 
this report. They range in population from 
less than a million (Cape Verde, Swaziland) 
to over 40 million (Ethiopia). They also vary 
considerably in size, from less than 2,000 
square kilometers (Mauritius) to 1,222,000 
square kilometers (Ethiopia). Eleven of the 
countries fall into the World Bank (1990) 
low-income category and three into the 
middle-income category. Economic differ- 
ences are reflected in annual per capita GNP 
that ranges from $110 (in Ethiopia) to $790 
(in Swaziland) and $1,090 (in Mauritius) 
(Table 2.1). Even these figures may under- 
estimate the extent of poverty in countries 
(Swaziland, Ministry of Education 1985). 
Since they are based on the monetary as- 
sessment of activities related to the modern 
sector of the economy (that in many cases 
relies heavUy on foreign capital), they throv/ 



Table 2.1 

POPULATION, AREA, AND PER CAPITA GNP 
OF STUDY COUNTRIES, 1984 



Countries/ 
linguistic 
status 


Population 
(millions) 


Area 
(thousands of 
square kms) 


Per capita 
GNP($) 


Anglophone 








Kenya 


19.5 


583 


310 


Lesotho 


1.5 


30 


530 


Mauritius 


1.0 


2 


1,090 


Swaziland 


0.7 


17 


790 


Uganda 


15.0 


236 


230 


Zambia 


6.4 


753 


470 


Francophone 








Chad 


4.9 


1,284 




Guinea 


5.9 


246 


330 


Madagascar 


9.9 


587 


260 


Mauritania 


1.7 


1,031 


450 


Rwanda 




26 


280 


Togo 


2.9 


57 


250 


Other 








Cape Verde 


0.3 


4 




Ethiopia 


42.2 


1,222 


110 



Source: World Bank (1988), except forCajw Verde, for which 
Unesco (1988) data for 1985 are used. 
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little light on the standard of living of the 
majority of the population who in all the 
countries live in rural areas and are engaged 
in the traditional sector of the economy, that 
is mainly agriculture. 

Some of the countries are ethnically and 
culturally fairly homogenous; others are 
very diverse. In some countries, for ex- 
ample, a single language is spoken by most 
of the population (Cape Verde, Lesotho, 
Madagascar, Swaziland). In others, and this 
is the more common situation, a diversity of 
languages and dialects is in use (see World 
Bank 1988). 

Differences among countries, that we will 
again advert to when considering the edu- 
cational and examination systems of the 
countries, are outlined here to draw atten- 
tion to the fact that any general conclusions 
reached in this report will have to be 
adapted and interpreted within the context 
of the particular circumstances of each indi- 
vidual country. 

Cunent Size and Participation Rates of 
Educational Systems 

Twelve of the fourteen countries in- 
cluded in our survey have either twelve or 
thirteen school grades altogether; one has 
eleven and one has fourteen. All the sys- 
tems are divided into primary and second- 
ary sectors. At the primary level, one coun- 
try has five grades, seven have six grades, 
four have seven grades, and two have eight 
grades. At the secondary level, one country 
has four grades, four have five grades, five 
have six grades, and four have seven grades 
(Appendix 1). 

Kenya has the largest number of pupils 
in primary schools followed by Ethiopia, 
Uganda, Madagascar, and Zambia (Table 
2.2). In 1986, the gross primary enrollment 
ratio of the countries varied from 29 percent 
(Guinea) to 115 percent (Lesotho) (Table 2.2). 
The gross enrollment ratio for six of the 



countries exceeded 100. Figures over 100 
percent can be attributed to the relatively 
high number of over-age pupils in primary 
school. The percentage of primary-school 
students who were female ranged from a 
low of 28 percent (Chad) to a high of 56 
percent (Lesotho). 

Relatively small nuinbers of students ad- 
vance to secondary school. In all but three 
countries, the gross enrollment ratio at the 
secondary level was less than 25 percent in 
1986. Ratios at the secondary level exceeded 
20 percent in only five of our study coun- 
tries (Lesotho, Madagascar, Mauritius, 
Swaziland, Togo). Female participation was 
lower at the secondary than at the primary 
level. In nine of the fourteen countries, fe- 
males constituted less than 40 percent of to- 
tal enrollment (Table 2.2). Lesotho is the 
only country in which the number of female 
secondary-school students was greater than 
the number of males. Thf^ ratio of primary 
to secondary pupils was particularly large 
in a number of countries, most notably 
Rwanda (43:1), Uganda (12:1), Kenya (11:1), 
Zambia (9:1), and Lesotho (8:1). Clearly, for 
the vast majority of pupils, formal educa- 
tion can be equated with primary school- 
ing. 

Concern with Quality of Provision 

In recent decades, in each of ihe four- 
teen countries reviewed, the challenge for 
Ministries of Education was to provide 
schools and teachers for a dramatically in- 
creasing population. To date, the emphasis 
appears to have been on quantity rather than 
on quality, with the result that concern has 
been expressed with many aspects of the 
quality of educational provision. In many 
countries, teacher morale, for instance, ap- 
pears to be low. In Ethiopia, one study 
reported that 40 percent of primary and 76 
percent of secondary teachers would, if 
given the opportunity, abandon the teach- 
ing profession (ERGESE 1986). In Lesotho 
in 1988, 805 teachers and almost 55,000 pu- 
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pils had no shelter. In four of the fourteen 
countries, class size has increased between 
1983 and 1986. The pupil-teacher ratio in 
Mauritania has gone from 24:1 (1970-71) to 
50:1 (1986-87). Class sizes as large as 120 
have been reported for Togo. In many in- 
stances, attendance rates are poor. Children 
may be absent to help their parents either in 
the home or with planting or harvesting. 

Table 2.2 

ENROLLMENT AND PARTICIPATION RATES 
Primary Secondary 



Countries/ Gross Gross 

linguistic Number enrollment Number enrollment 
status (OOOs) % female ratio (OOOs) % female ratio 



Anglophone 














Kenya 


5124* 


49* 


96* 


540* 


40* 


20 


Lesotho 


330* 


56 


115 


39 


60* 


24 


Mauritius 


145 


49 


107 


71 


47 


51 


Swaziland 


142 


50 


105 


32 


50 


42 


Uganda 


2204 


45 


68 


187 


33 


9 


Zambia 


1366 


47 


96 


145 


37 


18 


Fiancophone 














Chad 


341 


28 


43 


44 


16* 


6 


Guinea 


270 


31 


29 


77* 


25* 


15* 


Madagascar 1492* 


48 


124 


357* 


44 


42 


Mauritania 


157* 


40* 


51 


37* 


30* 


16 


Rvvsnda 


904 


48 


65 


21 


34 


3 


Togo 


511 


38 


102 


78* 


24 


21 


Other 














Cape Verde 


66* 


49 


108 


7* 


30* 


14 


Ethiopia 


2884* 


39 


38 


843* 


39* 


14 



Source: World Bank (1990), 
* Updated in national report. 



In its policy study, Education in Sub- 
Saharan Africa, the World Bank (1988) con- 
cluded that "... the safest investment in edu- 
cational quality in most countries is to make 
sure that there are enough books and sup- 
plies" (p. 4). Other studies have shown that, 
in the case of developing countries, factors 
such as school facilities, textbook availabil- 
ity, and teacher training account for a large 
portion of the variation in student achieve- 
ment (Eisemon 1988; Fuller 1987; Heyneman 
and Loxley 1983). 

Resources that are lacking include such 
basic items as desks and chairs as in Togo. 
Many of the national reports commented on 
the lack of basic materials, most notably text- 
books. In Madagascar, up to ten students 
share a textbook. Over a sixteen-year pe- 
riod, education in Guinea was conducted 
practically without any textbooks. Many 
textbooks used in Cape Verde are produced 
in Portugal, primarily for the home market, 
and do not provide an adequate coverage 
of the official local syllabus. In Kenya and 
Madagascar, as wei' as in other countries, 
basic science equipment is either in short 
supply or, in some instances, is nonexistent 
in secondary schools. 

Resource availability has implications 
both for the format and functioning of pub- 
lic examinations. In particular, practical ex- 
aminations in subjects such as woodwork, 
metalwork, and home economics require 
basic materials, not alone at examination 
time but also during the school year. Lack 
of appropriate resources is one of the main 
impediments to the introduction of more 
appropriate forms of assessment (essay, 
practical, oral, and aural) in Ethiopia. Prob- 
lems have been experienced in Chad and 
Swaziland, as well as in other countries, in 
the acquisition of equipment for practical 
subjects. 
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Scarcity of Places 

The percentage of students progressing 
from the final grade of primary to the first 
grade of general secondary education is in- 
fluenced greatly by the number of available 
secondary school places. Students complet- 
ing primary school compete against each 
other for the relatively small number of 
places at the higher level. At one extreme, 
80 percent of Ethiopian primary-school 
graduates transfer to secondary school while, 
at the other, as few as 4 percent of Rwandan 
students with the same attainment level do 
so. However, in the former case, it should 
be noted that the gross primary enrollment 
ratio is very low (38 percent). For eleven of 
the thirteen countries for which transfer data 
were available (Table 2.3), less than 50 per- 
cent of students advanced from the last 
grade of primary to the first grade of sec- 
ondary school. In Uganda, for example, 
approximately one-third of the students 
completing the primary-leaving examination 
can expect to be accommodated at second- 
ary level. In Kenya, of the 341,000 who sat 
for the primary-leaving examination (KCPE) 
in 1987, 51 percent were successful )^ ob- 
taining places at the next level. In Malawi 
(examined in an earlier study), in 1986-87, 
the number of places in Form 1 of the sec- 
ondary system only amounted to 7.6 per- 
cent of the total Grade 8 enrollment 
(Kellaghan and Greaney 1989). The bottle- 
neck between primary and secondary school 
gives rise to great pressure on students to 
perform well on the primary school-leaving 
examination, that normally serves as the 
selection test for secondary school. 

Repetition 

Traditionally, grade repetition has been 
used as an indicator of educational ineffi- 
ciency. High repetition rates, especially in 



educational systems that cannot accommo- 
date all children of school-going age, repre- 
sent a waste of scarce resources. While some 
repetition is to be expected for reasons such 
as illness or low achievement, the relatively 
high levels reported for the countries in this 
study (Table 2.4) is cause for concern. Rep- 
etition ranges from 2 percent of total enroll- 
ment in Zambia to 35 percent in Togo. On 

Table 2.3 
PERCENTAGES OF STUDENTS 

PROGRESSING FROM 
THE LAST GRADE OF PRIMARY 
TO FIRST GRADE OF 
SECONDARY SCHOOL, 1986 

Countries/ 
linguistic 

status Percentage 



Anglophone 

Kenya 

Lesotho 

Mauritius 

Swaziland 

Ugand 

Zambia 

Francophone 

Chad 

Guinea 

Madagascar 

Mauritania 

Rwanda 

Togo 

Other 

Cape Verde 
Ethiopia 



28* 
26» 
43 
67 
NA 
23* 



19 
27 
28 
29 
12»» 
34 



45 
80 



Source: World Bank (1990). 

♦ 1970. 

• Data for an adjacent year. 
1989-90. 
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Table 2.4 
REPEATERS AS A PERCENTAGE OF 
TOTAL ENROLLMENT, 1986 



Countries/ 
linguistic 

status Primary Secondary 



Anglophone 

Kenya 13 NA 

Lesotho 23 NA 

Mauritius 7 14 

Swa2:iland 15 8 

Uganda 14 NA 

Zambia 2 2** 

Francophone 

Chad 24 11* 

Guinea 25 38 

Madagascar 29* 20** 

Mauritania (1987-88) 19+ First cycle 1 1 + 

Second cycle 16+ 

Rwanda (1987-88) 11+ 6+ 

Togo 35 32 

Other 

Cape Verde (1988) 27 15+ 

Ethiopia 10 11 



» 1970. 

** Adjacent year. 

+ National Examinations Report. 

the whole, repetition at secondary level, 
though still substantial, is lower than at pri- 
mary level. Data for Sub-Saharan African 
countries in general show that the rate of 
repetition for Francophone countries is ap- 
proximately four times that for Anglophone 
countries. Among the countries in our 
study, the highest repetition rates were re- 
corded for four Francophone countries: 
Togo, Guinea, Chad, and Madagascar. 



Dropout 

Dropping out of school represents a 
waste of human and financial resources 
unless students acquire basic skills during 
their time at school. There is a considerable 
body of evidence to indicate that large per- 
centages of students fail to reach the final 
grade of primary school in Africa. Some of 
this evidence has taken the form of report- 
ing the proportion of a cohort that reaches 
the final grade. 

Available data indicate that in almost half 
of the countries in our study, fewer than 50 
percent of those entering primary school per- 
sist to the final grade of the primary school 
(Table 2.5). In Lesotho, it has been estimated 
that about one-quarter of those entering the 
lowest level complete primary school (Le- 
sotho, Ministry of Education 1987, p. 13). 

Recent Ethiopian data highlight the ex- 
tent of early dropping out of school. In 1987, 
the enrollment figure in Grade 2 (N: 440,515) 
was less than half that in Grade 1 (N: 
942,541). In Grade 3 (N: 350,197), there was 
a further drop of almost 100,000 pupils. 
While grade repetition would account for 
some of these differences, early dropout ap- 
pears to be the main reason for the sharp 
decline in enrollment figures. 

In Lesotho and Swaziland, the highest 
dropout rates at the primary level were re- 
corded at the early and final grade levels. 

Evidence from a number of countries sug- 
gests that the dropout rate is higher at the 
secondary than at the primary level. In Togo, 
for instance, in 1986, the dropout rate at pri- 
mary level was 10.2 percent; it was almost 
twice as high (19.4 percent) over the first four- 
year period of secondary schooling. 
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Table 2.5 
DROPOUT: PROPORTION OF 
COHORT (N: 1000) 
REACHING THE FINAL 
PRIMARY-SCHOOL GRADE, 1986 



V^Uii 1 1 iriL s> / 


Drotx)Ut 




Ind6x 


Status 




Anglophone 




Kenya 


NA 


Lesotho 


517* 


Mauritius 


959* 


Swaziland 


615 


Uganda 


NA 


Zambia 


801* 


Francophone 




Chad 


172 


Guinea 


437* 


Madagascar 


NA 


Mauritania 


923* 


Rwanda 


486* 


Togo 


592* 


Other 




Cape Verde 


340* 


Ethiopia 


496* 



Source: World Bank 1990. 
• Data for adjacent year. 



In a Swazi study of reasons for dropping 
out at the primary level, students who 
dropped out and their parents cited finan- 
cial difficulty as the most important cause. 
Teachers, on the other hand, attributed drop- 
out to poor school performance and lack of 
interest in studies, though they accepted that 
financial difficulty played a role. With one 
exception, similar reasons were advanced for 
dropout at the secondary level; the excep- 
tion was the claim of dropouts that the main 



reason for not continuing in school was the 
non-availability of a higher grade in the area 
in that they lived (Swaziland, Ministry of 
Education 1986). We cannot, of course, as- 
sume that reasons for dropout would be the 
same in other countries. 

Teacher Quality 

Most of the educational systems in our 
study have large numbers of untrained 
teachers. For example, the majority of pri- 
mary teachers in Cape Verde have no for- 
mal qualification. Frequentiy, ti\ose who fail 
to gain admission to teacher training on the 
basis of performance on a series of achieve- 
ment tests are offered teaching positions in 
areas where there is a shortage. In Lesotho, 
19 percent of primary and 16 percent of sec- 
ondary teachers have no formal teaching 
qualification. In Ethiopia, approximately one 
in four primary and secondary teachers have 
had no professional training; in fact, a total 
of 11 percent had less than twelve years of 
formal school experience. At the secondary 
level, one in five 7th and 8th Grade teachers 
had a college qualification, while fewer than 
one in two of those teaching the final two 
years of secondary school had a university 
degree (ERGESE 1986). Madagascar authori- 
ties, faced with the difficulty of recruiting 
teachers for rural areas, have filled vacan- 
cies with men and women doing their na- 
tional service. While the percentage of quali- 
fied teachers has improved dramatically in 
recent years in a number of countries (most 
notably Swaziland), the Kenya teaching force 
had a lower percentage of trained primary 
teachers in 1988 than in 1%3. Like most other 
countries, Kenya has experienced a shortage 
of teachers of specialized subjects. 

While entry qualifications to teacher- 
training colleges vary considerably, they 
generally tend to be low. Primary pre-ser- 
vice teachers in Mauritius embark on a two- 
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year teacher-education program after pass- 
ing the senior cycle examinations. In Mau- 
ritania, candidates for the one-year teacher- 
training program should have passed the 
Baccalaureat; those without this academic 
qualification may still opt for teacher train- 
ing by undergoing a three-year course. In 
Madagascar, on the other hand, entrants to 
teacher training for primary school are re- 
quired to have passed only the junior-cycle 
examinadon (CFEPCES) of the secondary 
school. They are then required to undergo 
a two-year training period and a further year 
of practical training. 

Low salary levels are perceived to con- 
tribute to the low status of teachers though 
teachers' salaries in Africa are two to three 
times higher relative to income per capita 
than in Asia or Latin America (Mingat and 
Psacharopoulos 1985). The median salary 
around 1986 for teachers in countries in the 
study for that we had data was close to 
$1,400 for primary teachers and $2,200 for 
secondary teachers. But there were 
exceptions to this. In Madagascar, teacher 
salaries generally range from $45 to $63 per 
month. The value of this salary is brought 
into sharp focus when one considers that 
rice costs an average family about $28 per 
month, while rent for a simple apartment 



amounts to around $26 per month. It is 
evident that in this instance a teacher's sal- 
ary cannot support a family. In Chad, 
unsalaried teaching assistants are often sup- 
ported by the villages. In Uganda, the very 
low level of state salaries necessitates the 
raising of most of a teacher's income through 
direct parents' contributions and local fund- 
raising efforts. 

It may be important to distinguish 
teacher quality from teaching quality. The 
findings of research relating to indices of 
teacher quality, such as teacher education 
and teacher experience, are not consistent. 
In some studies they have been found to be 
related to student achievement, in others not. 
In general, however, it seems that formal 
teacher education is less effective in Africa 
than in other developing-country regions. 
Further, the effects of teaching experience 
have generally been found to be less posi- 
tive than the effects of formal teacher edu- 
cation. However, in analyses of lEA data 
collected in Swaziland, while teacher qual- 
ity (education and experience) did not cor- 
relate with student achievement (when stu- 
dent background and school characteristics 
were controlled), the effects of teaching qual- 
ity (expressed in terms of teaching process 
variables) were manifest (Lockheed and 
Komenan 1989). 
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4 Public Examinations 



In this chapter, we provide a description 
of the examination systems of the fourteen 
countries included in our study, based on 
the reports prepared lor the individual coun- 
tries. 

Tradition 

Examination systems in African coun- 
tries, not surprisingly, have been strongly 
influenced by traditions in the European 
countries that colonized them. Following 
traditions that are both British and French, 
examinations are formal, terminal, and sub- 
ject-based. Countries in Francophone Af- 
rica use the French Baccalaureat system at 
the end of secondary school, while Anglo- 
phone countries have had close ties with 
British examining boards. In fact, the final 
school-leaving examination (GCE) in two of 
these countries continues to be set and 
marked in Britain. Anglophone countries 
have also tended to use features of British 
examinations such as moderators. In recent 
years, national examination systems have be- 
ccMTie more independent and have tended 
to develop their own examinations. The 
problem of processing very substantial num- 
bers of examinations has led to an increas- 
ing reliance on multiple-choice tests, favored 
by educational systems in the United States. 

Titles and Descriptions of Exa^^inations 

A total of fifty-two public examinations 
offered at primary and secondary (general) 
levels of education was identified. In addi- 
tion to these, many examination bodies of- 



fered a range of other public examinations 
in the areas of vocational education and 
teacher training. The numbers of candidates 
taking these examinations are small com- 
pared to the numbers taking public exami- 
nations at the primary and secondary lev- 
els. Vocational and teacher- training exami- 
nations were considered to be beyond the 
scope of the present study. In general, pub- 
lic examinations are offered at the end of 
primary schooling, midway through the 
secondary school, and at the end of second- 
ary schooling. Students in Francophone 
countries tend to be subjected to more ex- 
aminations than those in Anglophone coun- 
tries. In particular, additional examinations 
are administered during the primary school 
years in Francophone countries. In a num- 
ber of Francophone countries, also, a com- 
petitive examination, termed the concours, is 
used to select pupils for the next highest 
educational level. 

Written essay examinations are offered 
in most countries. In two countries, how- 
ever (Ethiopia and Zambia), the multiple- 
choice format predominates. The broad ar- 
ray of examination formats offered also in- 
cludes practicals, orals, and aurals. Anglo- 
phone countries in general tend to use a va- 
riety of examination types. In each of these 
countries practical tests are used in public 
examinations. Virtually all use essay and 
multiple-choice items in at least one public 
examination. Four Anglophone countries in- 
clude aural components in their public ex- 
aminations. Other formats (oral, projects, 
short-answer) are used less frequentiy. Fran- 



ERIC 



23 

3 kJ 



cophone countries tend to opt for the writ- 
ten and oral formats. 

For each of the fourteen countries in our 
study, details of examination titles, types, 
functions, and the stage of education at 
which ihey are administered are given in 
Appendix 2. The name of the agency that 
has responsibility for each public examina- 
tion is also given. 

Size of Examination Enterprise 

The primary school-leaving certificate ex- 
amination is clearly the most significant in 
numerical terms (Table 3.1). Kenya 
(N:354,802), Ethiopia (N:281,734), Zambia 
(N:197,000), and Madagascar (N:192,405) 
have the largest numbers of candidates for 
this examination. In all but two (Ethiopia 
and Swaziland) of the fourteen countries the 
number of secondary junior-cycle candidates 
in the system is less than half the number of 
primary candidates. Over 100,000 take the 
secondary school-leaving examination in 
Ethiopia (N:175,277) and Kenya (N:131,000). 
In the case of all but these two countries, 
the senior-cycle school-leaving certificate 
candidates total fewer than one-quarter of 
the Tiumber of primary candidates. In ap- 
proximately half of the countries for which 
data were available, fewer than 5,000 candi- 
dates took the senior-cycle terminal exami- 
nation. 

Setting of Examinations 

Three distinctively different approaches 
are used for writing items and setting ex- 
amination questions in the countries re- 
viewed. 

First, in a number of countries with de- 
veloped national examination centres, such 
as Kenya, Swaziland and Mauritius, much 
of the work is conducted by staff members 
working closely with others, usually teach- 
ers. In these countries, multiple-choice is 
the preferred examination format. 

o 
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Second, in Francophone countries, in 
general, a less formal approach is used that 
allows for much more direct input from 
teachers. In Guinea, for instance, secondary- 
school teachers are asked to submit topics 
for examination. A commission adds its own 
topics from a data bank. The Minister then 
makes the final choice of questions. Teach- 
ers who set the examinations may have 
unrealistic goals and expectations. In 
Rwanda and Mauritania, the Minister is 
closely involved in the examination-setting 
process; concern over test security is the pri- 
mary reason for the adoption of this proce- 
dure. The ability of teachers to judge the 
appropriateness of items or to estimate the 
time required to answer individual papers 
has attracted aitical comment. In Rwanda, 
for example, an examination for which a 
three-hour time period was set aside was 
completed in a half-hour by the candidates. 

Third, in some countries (Lesotho and 
Zambia) formal courses for examiners are 
organized by examination councils. In 1987, 
in Lesotho, Primary Certificate multiple- 
choice items were written by teachers and 
subject specialists in specially organized 
workshops. Final examine tion items were 
selected on the basis of their degree of dis- 
crimination and difficulty, and on the judg- 
ment of subject specialists. 

In a small number of countries, the writ- 
ing of items for the terminal secondary- 
school examination is entrusted to univer- 
sity personnel. In Chad and Ethiopia, items 
are written by staff members from the Uni- 
versity of Chad and the University of Addis 
Ababa respectively. 

Use of Aptitude Tests 

Scholastic aptitude tests have not proved 
popular in the context of public examina- 
tions in Africa. This is perhaps because they 
have not been very popular in Europe ei- 
ther, as compared, for example, with the 
United States. There are a number of other 
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Table 3.1 
SIZE OF EXAMINATION ENTERPRISE 



Countries/ 
linguistic 
status 



Anglophone 

Kenya (1988) 

Lesotho (1987) 
Mauritius (1989) 
Swaziland (1987) 
Uganda (1989) 
Zambia (1987) 



Prin\ary 



KCPE 
354,802 



PSLCE 
23,998 

CPE 

:j3,083 

PC 

13,943 

PLE 
134,669 

G7 

197,000 



Secondary 



KCE 

(Discontinued, 
1987) 

TCE 
6,642 

SC 

11,141 
JCE 

7,500(1988) 

UCE 
42,507 

G9 

59,933 



KSE 
131,000, 



cose 

2,790 

HSC 
3,977 

COSC 
2,561 

UACE 
13,248 

SC 

15,343 



Francophone 

Chad (1988) 

Guinea (1988) 



Mauritania (1988) 
Rwanda 



CEPEICEPEA 
17,840 

7th year 

Entrance 

24,668 



Concours 
20,550 



CEPE 

Madagascar (1988) 192,405 



Togo (1987) 



CEE 
23,680 

CEP 



NA 



CEPD 
46,364 



1st year 

Secondary 

23,680 

Concoun 
57,089 



BEPC 
7,985 



BEPC 
12,148 

(ii) 4209 

CFEPCES 
84,635 



BEPC 
3,463 

Examens de redassemeni 
2-2,500 

End of 3rd 
year 3^00 

BEPC 
18,190 

(ii) 5610 



Bac 
NA 



Bac 

(i) 9290 



Bac 
47,624 



Bac 
7,361 



NA 



Bac 

(i)5163 



Other 



Cape Verde 



Ethiopia (1988) 
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End of 
Elementary 

NA 

G6 

281,734 



Basic 
Complementary 

NA 
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First Cycle 
General 

NA 

G8 

237,011 



an 



Second Cycle 
Complementary 

NA 

ESLCE 
175,277 



possible reasons for their lack of popularity. 
First, curricula in schools are more closely 
prescribed in Africa (as they are in Europe) 
than in the United States. Second, in a num- 
ber of studies, scores on scholastic aptitude 
tests have been found to predict performance 
in third-level institutions less well than sub- 
ject-based examinations (see O'Rourke, 
Martin, and Hurley 1989). Third, the use of 
an aptitude test might lead schools to em- 
phasize preparation for this kind of test at 
the expense of covering material designed 
to achieve curricular objectives. 

It can be argued that a scholastic apti- 
tude test may still have certain advantages 
in certain situations. First, being neither 
criterion-referenced nor based on a single 
concept of subject excellence, it could allow 
local school authorities to experiment with 
curriculum. Second, it might have a par- 
ticular value in countries in which school 
inputs and facilities vary widely, insofar as 
it is less sensitive than achievement tests to 
the differential opportunities of students to 
learn (Heyneman 1987). 

In Africa, two countries used aptitude 
tests for a number of years but discontinued 
the practice. An aptitude test was adminis- 
tered as part of the Ethiopian School-Leav- 
ing Certificate Examination between 1967 
and 1974. In Lesotho, verbal reasoning and 
numerical ability tests were introduced in 
the 1970s to be used in conjunction with the 
achievement tests of the primary-school cer- 
tificate examination to select students for sec- 
ondary school. Sebatane (1985) reports that 
the "predictive validity" of the tests was 
"professionally established" but does not re- 
port any details. The results of the ability 
and achievement tests were combined, a 
practice described by Sebatane as "unten- 
able." The practice of administering the abil- 
ity tests has been discontinued. 

The most consistent use of aptitude tests 
has been in Zambia. Verbal and nonverbal 



reasoning tests are administered in conjunc- 
tion with four subject achievement tests in 
the primary school-certificate examination. 
In a small-scale study in the 1960s, it was 
found that ability tests (measuring verbal 
reasoning, nonverbal ^ masoning, and numeri- 
cal skills), that were administered in addi- 
tion to, but not as part of, the secondary- 
school selection examination of achievement, 
were better predictors than the selection ex- 
amination of performance on the Junior 
Certificate national examination taken two 
years later (Irvine 1968). In further studies 
of the predictive validity of the examina- 
tions, reported in a note prepared by the Psy- 
chological Service of the Ministry of Educa- 
te* on, performance on the verbal-reasoning 
test was the best predictor of success at sec- 
ondary school. Performances in the English 
certification examination and on the nonver- 
bal reasoning test were the next best predic- 
tors. In particular, and not unexpectedly, 
the spatial component of the nonverbal test 
was found to have "a very high correlation" 
with performance in mathematics and physi- 
cal sciences. Furthermore, performance on 
the nonverbal reasoning test was found to 
correlate "very well with success at techni- 
cal courses at tertiary level." Unfortunately, 
we do not have more details of these stud- 
ies — for example, the magnitude of the cor- 
relations between performance on the apti- 
tude tests and later school performance — but 
further information about this research 
would obviously be of considerable interest 
in the context of the selective functions of 
public examinations. 

School-based Components of 
Examinations 

A few systems currently include assess- 
ments conducted by students' teachers as 
part of the final examination grade. The 
junior-secondary cycle examination in Le- 
sotho has elements of school-based assess- 
ment, while in Ethiopia, a total of 30 per- 
cent of the total marks for the primary 
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school-leaving examination (G6) is awarded 
for school-based assessments. 

Despite the potential advantages of this 
form of assessment, especially from the va- 
lidity perspective, a number of problems 
have been observed in its use. A lack of 
variance in school-based marks has been 
noted; marks tend to be inflated. Some 
schools fail to submit students' school-based 
assessment marks in time. In such instances, 
candidates in Ethiopia are awarded the same 
percentage marks for school-based work as 
they achieved in the public examination. 
Since school-based marks are usually higher 
than examination marks, these candidates 
tend to be penalized due to the failure to 
return school-based marks. 

Marks derived from school-based assess- 
ments, at one time used to contribute to the 
total marks for the Baccalaureat in Guinea, 
are no longer used because serious discrep- 
ancies were found between the school-based 
and non-school-based elements of the ex- 
amination. Discontinuation of the practice 
in Guinea has contributed to an observed 
increase in discipline problems, less regular 
attendance, and a nonchalant attitude to- 
wards school examinations. 

Scoring 

In most systems, scoring or marking of 
state examinations is carried out by practic- 
ing teachers. In fact, this exercise is consid- 
ered a most useful form of in-service teacher 
education for its participants since it high- 
lights the essential elements of the curricu- 
lum, standards expected, and marking pro- 
cedures. In Cape Verde, scoring is entrusted 
to the candidates' teachers. Responsibility 
for scoring some public examinations is as- 
signed to regional or local committees of 
teachers in Togo and Madagascar. In Swazi- 
land, moderators are used to scrutinize a 
sample (10 percent) of scripts marked by 
teachers and to recommend, if necessary, 
changes in the scoring. 



In other countries, notably Kenya, Le- 
sotho, Mauritius, and Zambia, multiple- 
choice tests are machine-scored. Ethiopia's 
ESLCE has been machine-scored by the Uni- 
versity of Addis Ababa since 1977. 
Ethiopia's other national examinarions are 
scored by large groups of university students 
or members of youth organizations. 

Systems that require students to complete 
projects and /or administer practical exami- 
nations tend to have assessments conducted 
by outside teachers. In this case, and also 
where practicals are conducted by the shi- 
dents' own teachers, the process is often 
monitored by the school inspectorate. A 
number of examination systems (Lesotho, 
Mauritius, Swaziland) have their senior-cycle 
secondary school-leaving examinations set 
and scored by an agency outside the coun- 
try (the University of Cambridge Local Ex- 
amination Syndicate and London Umversity 
Schools' Examination Council). 

No formal reliability studies of public ex- 
aminations appear to have been conducted. 
To ensure the reliability of the scoring pro- 
cedure of essay-type examinations, several 
different procedures have been used. In 
Togo, papers are corrected once except in 
"cases where the score distribution shows a 
large deviation from the norm already 
known by the committee." (Unfortunately 
the country report does not indicate the 
source of this norm or elaborate on the term 
"score distribution"). In such instances, pa- 
pers are recorrected. In Mauritania and 
Madagascar, each paper is corrected twice; 
in Madagascar, the average mark is assigned 
except where the difference is "very large," 
in which case the paper is scored a third 
time. The scoring process adopted in Guinea 
clearly indicates that factors other than level 
of performance on the set questions in the 
examinadon affects a candidate's final mark. 
Scorers are made aware of candidates' school 
grades prior to correction. According to the 
national report "these records allow the jury 
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to more fairly mark those pupils who have 
not received a complete education covering 
all of the questions posed at the examina- 
tions." It seems reasonable to assume also 
that a student who performed well on the 
examination could have his or her mark re- 
duced in line with expectations derived from 
school grades. 

Technology 

The use of computers and optical-scan- 
ning machines allows for the processing of 
large amounts of examination data in a short 
period. Furthermore, if multiple-choice 
items are used, computerized item analysis 
facilitates the provision of feedback inJfor- 
mation to schools. 

To date, the use of computers and opti- 
cal scanning devices appears to have been 
confined in the main to Ethiopia, Kenya, Le- 
sotho, Swaziland, and Zambia. Dependence 
on modern technology is most pronounced 
in Kenya. Over 360,000 primary-school leav- 
ing-certificate examinations are scanned and 
analyzed in a year. Each year, through its 
KCPE Newsletter, schools are informed of the 
percentage of candidates in the country who 
answer each item correctly and in many 
instances the percentage opting for each 
distractor. Computers are also used to cal- 
culate national order of merit lists. 



to be discontinued as the process produced 
too many errors. In Ethiopia, the inability 
to obtain appropriate scanner parts due to a 
lack of appropriate arrangements for secur- 
ing foreign currency resulted in a return to 
hand scoring of the Grade 6 and Grade 8 
national examinations. 

Functions of Examinations 

In theory, public examinations are ex- 
pected to serve a number of different func- 
tions. For teachers and pupils, they can act 
as an incentive for greater effort. They are 
regarded as a fair means of distributing 
scarce educational benefits. They can pro- 
vide feedback to teachers and students on 
their strengths and weaknesses. Public ex- 
aminations can help unify the teaching ef- 
fort throughout an entire country around 
common goals and themes. For students, 
they provide formal evidence of educational 
achievement (certification). Public exami- 
nations may also serve an accountability role 
by offering evidence of standards attained 
by individual teachers and schools. Lastly, 
and most important in the present context, 
educational systems, governments, and other 
employers use examination results for se- 
lecting appropriate candidates for the next 
level of schooling or for employment. 

Selection 



Some examination systems rely on out- 
side agencies for computer services. Pro- 
cessing of the Ethiopian ESLCE is done by 
the University of Addis Ababa; in Zambia, 
machine-scoring of multiple-choice tests is 
undertaken by the Department of Finance, 
while other processing, including the pro- 
duction of certificates, is done at the Uni- 
versity of Zambia. 

Swaziland and Ethiopia have encoun- 
tered serious problems that have thwarted 
their efforts to use modern equipment to 
score large numbers of examinations effi- 
ciently. In the former, machine-scoring had 
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In practice since educational opportuni- 
ties form a pyramid with fewer places avail- 
able at each successive level, the primary 
function of almost all public examinations 
reviewed in the fourteen countries in our 
study is selection. While most of the exami- 
nations also serve a certification function, 
some, most notably the concours in Franco- 
phone countries, are designed solely to se- 
lect students for the next highest level of the 
educational system. The highly competitive 
concours is used, for instance, in Togo at the 
end of the secondary junior-cycle to select 
students for the three-year senior-cycle pro- 
gram and again at the end of this cycle to 
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select candidates for colleges and universi- 
ties and for foreign study. 

The capacity of educational systems 
rather than the academic achievement of 
students plays the crucial role in deterrrun- 
ing the percentage of pupils who advance 
to the next highest level. Lack of schools, 
especially secondary schools, inevitably re- 
sults in a severe bottleneck at the end of 
primary school. The number of selected or 
promoted students depends ultimately on 
the number of available places. Pressure for 
a place in a secondary school is most pro- 
nounced in Rwanda, Uganda, Chad, and 
Zambia. In Ethiopia, on the other hand, 
little selection pressure at the end of pri- 
mary school is due to the ready availability 
of places; the vast majority of students can 
transfer to secondary school. Here, as in 
the other countries, however, the selection 
factor is emphasized at the end of senior 
cycle. Evidence for this claim is provided 
by the large number who repeat the ESLCE 
in the hope of improving their grade-point 
average to qualify for one of the relatively 
few available places in third-level educa- 
tional institutions. 

In a number of Francophone countries, 
rigid marking systems are employed at end- 
of-year grade examinations, administered to 
select or to promote students to the next 
highest grade. Among the most severe is 
that employed in Chad secondary schools 
in which a mean mark of ten or more is 
required for promotion, greater than seven 
and less than ten for repetition, while a mark 
of seven or less results in expulsion. Given 
what is known about the extent of marker 
unreliability in examinations, this procedure 
obviously presents problems. If, for ex- 
ample, a student obtained a score of 8.5 on 
a test with a sfrandard error of measurement 
of 0.8 we could say that the individual's 
"true" score lies between 10.1 and 6.9 with 
a 95 percent level of confidence. This range 
encompasses each of the critical promotion. 



retention, and expulsion cut-off points. 
Thus, it is reasonable to assert that a stu- 
dent who was expelled from school on the 
basis of examination performance could 
have merited either retention or promotion 
had an accurate measure of student achieve- 
ment been available. 

Since the selection function of examina- 
tions relates to the identification of students 
who are most likely to succeed at the next 
highest level, the lack of studies of the pre- 
dictive validity of examinations is surpris- 
ing. Clearly it would be possible to increase 
the efficiency of the selection process by 
using shorter tests. Such tests would re- 
quire less supervision and less time in mark- 
ing and in analysis and so could result in 
substantial financial savings. Overempha- 
sis on increasing the efficiency of the selec- 
tion function, however, would inevitably run 
the risk of reducing the content coverage of 
the examinations (see Chapter 5). As a con- 
sequence, we would expect that over time 
sections of the curriculum not being exam- 
ined would be neglected in schools. The 
combination of selection efficiency and cur- 
ricular validity in examinations involves a 
delicate balance. 

Certification 

The emphasis on the selection function 
of examinations is so pervasive that there is 
a danger of losing sight of their certification 
function. With the exception of the concours 
and those taken in some countries prior to 
the primary school-leaving examinations, 
virtually all of the examinations have a cer- 
tification function. Formal certificates that 
indicate candidates' academic achievements 
may be important credentials for gaining 
employment or for qualifying for further 
training. In Ethiopia, for example, posses- 
sion of the Grade 6 and Grade 8 certificates 
may be required as a minimum qualifica- 
tion for a range of occupations, for example 
drivers and filing clerks. Lower level cer- 
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tificates, however, as the numbers possess- 
ing them increase, are losing their currency 
in the labor market. 

Tlxere has been a growing tendency in 
recent years to use the same test to meet 
selection and certification requirements. In 
Mauritius, for instance, prior to the intro- 
duction of the present Certificate of Primary 
Education (CPE), a primary school-leaving 
certificate served certification requirements 
while a different examination (Junior Schol- 
arship) administered around the same time 
satisfied the selection requirement. A real- 
ization that the two formal examinations 
contributed to excessive pressure on ten- and 
eleven-year olds led to the dropping of both 
examinations in favor of one (CPE) that now 
serves both functions. 

An examination may be an efficient se- 
lection device but may fail to serve the im- 
portant certification function. Certification, 
which is recognized as a function of exami- 
nations in all countries, is primarily con- 
cerned with providing a measure of curricu- 
lum coverage. Adequate curriculum cover- 
age is more likely to be provided in broad- 
based examinations that extensively sample 
the prescribed syllabus than in examinations 
that are confined to narrow content domains, 
which cover material that is normally not 
directly prescribed in school curricula, such 
as nonverbal reasoning ability, or that are 
confined to one or two assessment proce- 
dures. 

Accountability 

Public-examination results are frequently 
perceived as providing evidence of school 
effectiveness. In a number of countries, 
schools and teachers may be held account- 
able for their students' achievements as re- 
flected in performance on public examina- 
tions. The use of examination results to hold 
teachers or schools accountable is magnified 
when results are published. Even when re- 
sults are not formally published, education 
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officials may congratulate officials of schools 
in which students have performed well or 
require less successful schools to explain 
poor examination performance. 

Performance 

Attempting to summarize and provide 
figures comparable aaoss countries for ex- 
amination performance (such as are pre- 
sented in Table 3.2) is problematic. Such a 
summary fails to take into account differ- 
ences in criteria for awarding grades or in 
the structure of performance (that may in- 
volve compensation across subjects or reach- 
ing a particular level in specific subjects) that 
can merit a pass or a particular grade. Even 
within the same examination, different cri- 
teria can be used to indicate that a student 
has "passed." For example, in the school- 
leaving certificate examinations of a num- 
ber of countries, such as Kenya and Lesotho, 
to obtain a school certificate, a candidate 
must have passed in a specified number of 
subjects. However, candidates who do not 
obtain the specified number of passes may 
obtain a certificate in the subjects which they 
did pass. In our table, we provide figures 
for the students who pass the total certifi- 
cate examination and, when available, fig- 
ures for candidates who failed to get a gen- 
eral certificate but passed some subjects in 
the examination. Thus, problems in compa- 
rability can arise from the fact that what is 
meant by a pass can vary from examination 
to examination, not only between but also 
within countries. Further, in a number of 
countries (Kenya, Zambia), a distinction Is 
not made between pass and fail on the pri- 
mary school-leaving examination. 

To complicate matters, success or failure 
in the eyes of students, parents, and teach- 
ers may not be determined so much by ex- 
amination-performance level as by whether 
or not a student qualifies for a place at the 
next highest level of the educational system. 
A mark of 80 percent on a primary school- 
leaving examination may gain admission in 
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Table 32 

PUBUC-EXAMINATIONS PASS RATES 



Country/ 
linguistic 



Status 




Primary 


Secondary 


Anglophone 

Kenya (1987) 


KCPE 
Not applicable 

r r 




78.0% 


56.3% 


Lesotho (1987) 


PSLCE 
91.0% 




CE 

65.1-68.8% 
(1980-87) 


19.4%-31.7% 

(1980-87) 
62 2%-74 7% 
(GCE) 


Mauritius 


CPE 
58.4% 




SC 

58.1% 


HSC 
52.6% 


Swaziland (1988) 


PC 

79.6% 




JC 

67.3% 


COSC 
54.0% 


Uganda (1987) 


PLE 
82.2% (1989) 




UCE 
80.1% 


UACE 
66.4% 


Zambia (1983) 


G7 

Not applicable 




G9 

35.8% 


SC 
63.6% 

(GCE) 


Francophone 

Chad (1988) 


CEPE/CEPEA 
56.8% 


Concours 
35.3% 


49.8% 


Buc 
12.9% (1987) 


Guinea (1988) 


7th year 
Entrance 
56.6% 




BEPC 
48.8% 


(0 21.0% 
(ii)30.6% 


Madagascar (1988) 


CEPE 
49.0% (1987) 




CFEPCES 
26.7% 


Bac 

(i) 20.1% 

(ii) 18.2% 


Mauritania (1988) 


22.0% 


isl year vXX. 

292% 


BEPC 
37.6% 


Bac 
25.6% 




CEP 
NA 


Concours 
for Sec. 
7-9% 


VTA 

NA 
NA 


93.2% (Public) 
70.0% (Private) 


Togo 


CEPn 

NA 




BEPC 
NA 


Bac 
NA 


Other 


End of 
Elementary 


Basic 
Complementary 


First Cycle 
General 


Second Cycle 
Complementary 


Cape Verde (1987) 


67.3% 


56.9% 


NA 


NA 


Ethiopia 
(1987) 


G6 
82.5% 




G8 
68.3% 


ESLCE 
97.7% (Amhric) 
51 .9% (Math) 
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or country but may be insufficient to do so 
in another where there is a severe shortage 
of secondary-school places. 

Most systems tend to use some form of 
preset achievement standard to award 
marks. While the percentage of students 
getting various grades under this approach 
varies relatively little from year to year, 
notable variation does occur. In 1986 in 
Guinea, for example, 27.4 percent of candi- 
dates passed the Grade 7 entrance examina- 
tion. Two years later, this figure had more 
than doubled to 56.6 percent. 

A number of systems transform exami- 
nation marks into normalized scores, for ex- 
ample Ethiopia and Lesotho. Marks are 
transformed into standard scores so that 
individual students' reported scores reflect 
their performance relative to the perfor- 
mance of other students. Such an approach 
can tell us little about what a pass means in 
terms of a student's level of performance or 
knowledge. The standardization of scores 
ensures that, irrespective of level of achieve- 
ment, percentages passing, failing, or gain- 
ing distinctions are predetermined. Undue 
reliance on normalized scores can lead to 
the adoption of grading practices that bear 
little resemblance to educational realities 
(Sebatane 1985). For example, an indepen- 
dent study of the secondary school-leaving 
examination in Ethiopia reported that the 
cut-off raw score that distinguished between 
pass and failure on three of the 1986 sub- 
jects, English, history, and chemistry, ap- 
proximated the number of items that could 
be attributed to guessing the answer to each 
item (Cambridge Educational Consultants 
1988). 

The summary data in Table 3.2 reveal 
that large numbers of candidates were un- 
successful in public examinations. In a 
number of countries, fr^wer than one in four 
passed the primary school-leaving examina- 
tion. High failure rates (60 percent +) were 



also recorded on the junior and senior-cycle 
certificate examinations. In almost all coun- 
tries, pass rates were highest on the primary 
school-leaving examination and lowest on 
the secondary senior-cych examination. In 
general, the secondary-school pass rates 
seem to have been slightly lower in Franco- 
phone than in Anglophone countries. 

Within individual countries, substantial 
variation in performance rates has been re- 
corded between different regions. For ex- 
ample, the pass rate on the primary school- 
leaving examination (CEPE) in Madagascar 
was approximately 60 percent for candidates 
living in cities and as low as 20 percent for 
rural candidates. 

Repeat students tend to lower the mean 
pass rates. In 1988, repeat students repre- 
sented 59.4 percent of all candidates in Eti\io- 
pia for the ESLCE secondary leaving exami- 
nation. Their mean score (which was con- 
siderably belov; a D grade) placed them 
lower than other candidate categories. On 
the 1983 Zambian Junior Secondary-School 
Certificate Examination, the success rate of 
internal candidates (52.5 percent) was more 
than six times that of external candidates 
(8.4 percent). 

Examination Repetition 

Policies regarding examination repetition 
vary. Students who fail public examinations 
in Ethiopia may repeat the year in school 
provided there is sufficient accommodation; 
otherwise they must study outside of the 
public-school system. Madagascar permits 
multiple repeats on its primary-leaving ex- 
amination. On the other hand, Guinea and 
Mauritius limit the number of repeats while 
Zambia and Lesotho require the public- 
school candidates to pass some public ex- 
aminations on the first attempt. Both these 
countries, together with Kenya, Cape Verde, 
and Mauritius accept repeat piivate candi- 
dates. 
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Governance and Administration 

Public examinations are organized and 
administered either by the Ministry of Edu- 
cation (or special sections within the Minis- 
try) or by an independent body established 
specifically for this purpose. In general, in 
Francophone countries, responsibility is 
vested in the Ministry, while in a number of 
Anglophone countries, it is vested in an in- 
dependent examination board or council. In 
a relatively small number of countries, such 
as Ethiopia and Togo, the Ministry has re- 
sponsibility for primary and junior-cycle sec- 
ondary examinations, but the senior-cycle 
school-leaving examination (or part of it in 
the case of Togo) is administered by univer- 
sity authorities. Appendix 2 identifies the 
agency or body that has been given respon- 
sibility for individual public examinations 
or shares responsibility with external exami- 
nation organizations, for example the Uni- 
versity of Cambridge Local Examination 
Syndicate. 

Examination systems in Kenya, l^esotho, 
Swaziland, Mauritius, Zambia, aiid Uganda 
are run by independent boards. Member- 
ship of these boards tends to be drawn from 
a broad educational constituency. Ministries 
of Education are represented by one or more 
members. The membership of the Uganda 
National Examinations Board, for example, 
includes four ex officio members: the Vice- 
Chancellor of the University, the Chief Edu- 
cation Officer, the Chief Inspector of Schools, 
the Director of the National Curriculum 
Development Centre; seven elected members 
from professional bodies; and thirteen min- 
isterial appointees (mostly principals of dif- 
ferent types of schools and colleges). 

In general, examination sections within 
education ministries and examination boards 
publish syllabi and regulations for their 
examinations, appoint appropriate person- 
nel (markers, invigilators, etc.), and issue cer- 
tificates. 



There is a trend in Anglophone coun- 
tries, though not in Francophone ones, to- 
wards the devolution of responsibility for 
the administration of examinations to an 
authority other than the Ministry of Educa- 
tion. However, even in countries in which 
an examinations authority has responsibil- 
ity for examinations (for exariple, Ethiopia, 
Lesotho and Zambia), the authority still 
maintains close links with the Ministry and 
may be dependent on other bodies for a va- 
riety of services, such as marking of tests 
and computer facilities. 

Localization of Examinations 

A trend in countries in which students 
take foreign examinations as part of their 
normal schooling is to localize all examina- 
tions, that is, to have examinations controlled 
within the country. There are only three 
countries (Lesotho, Mauritius, and Swazi- 
land) in which the leaving-certificate exami- 
nation at the end of secondary schooling is 
designed and marked abroad (in Britain), 
and steps are being taken to change that situ- 
ation. Localization frees foreign currency 
for other activities, though whether the 
money will be made available for improv- 
ing the resources available for examinations 
is another matter. It also, however, raises 
questions about the maintenance of stan- 
dards and the acceptability of a country's 
educational qualifications in other countries. 
The localization of examinations, particularly 
at the end of secondary school, has been 
viewed with apprehension in some coun- 
tries in case standards should fall as a con- 
sequence. Governments, examination bod- 
ies, and the general public are very keen to 
see that this does not happen and that their 
school qualifications will have currency not 
only nationally but internationally. To 
achieve this, it vsdll be necessary for govern- 
ments to invest more in evaluation and re- 
search activities relating to examinations. 
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Ftuiding 

Information from a limited number of 
countries that have made appropriate data 
available suggests that levels of state fund- 
ing of public examinations vary consider- 
ably. At one extreme, Madagascar devotes 
10 percent of its total educational budget to 
public examinations. Chad and Rwanda, on 
the other hand, spend less than 0.5 percent 
on this exercise. Size of government expen- 
diture on public examinations expressed in 
monetary terms or as a percentage of cur- 
rent government expenditure on education 
may represent only part of the total exami- 
nation expenditure. Where Ministries of 
Education meet all examination costs as they 
arise, many, if not all of the costs, are ab- 
sorbed into the general operating budget of 
the Ministry. 

The difficulty of estimating or conduct- 
ing a comparative analysis of examination 
costs is compounded by the fact that the 
number of cost-incurring items differs 
among countries. In Cape Verde, for ex- 
ample, teachers who construct examination 
papers or who supervise at examination 
sessions are not paid. Furthermore, at the 
basic elementary level, markers are paid only 
for correcting external candidates' scripts. At 
the secondary level, markers are paid by the 
schools. 

In at least five of the countries reviewed 
(Kenya, Lesotho, Mauritius, Swaziland, and 
Zambia), public-examination bodies allocate 
considerable portions of their budgets to the 
purchase of foreign currencies. For security 
reasons, Kenya devotes roughly 15 percent 
of its total budget to external printing of its 
primary and secondary examinations. In 
Zambia, approximately 8,000 students take 
the GCE O-level examination each year, at a 
cost of $782,500 to the Examinations Coun- 
cil. Since the amount that the Council is 
permitted to charge candidates is not nearly 
sufficient to meet the GCE costs, it must sub- 
sidize the fee paid by each student. The 



country's deteriorating financial position and 
the difficulty of raising foreign currency 
place the continued operation of the exami- 
nation in jeopardy. Figures from Mauritius 
for 1986-87 indicate that foreign examina- 
tion syndicates acquired $1.16 million for 
fees for secondary-level examinations; Cam- 
bridge University Local Examination Syndi- 
cate received $970,000 of this total. Other 
countries that pay substantial amounts of 
foreign currency, mainly for senior-cycle 
leaving-certificate exanunations, are Lesotho 
and Swaziland. 

While the inevitable increase in candi- 
date numbers will inaease the cost of fund- 
ing public examinations, economies of scale 
should lessen unit costs. In Kenya and coun- 
tries dependent on externally produced and 
corrected examinations, local printing, ex- 
amination production, and correction could 
reduce costs. 

Some examination authorities raise funds 
through their publishing activities, notably 
by publishing copies of previously adminis- 
tered public-examination papers. 

Fees 

In general, fees for end of primary-school 
examinations are either not charged or are 
kept to a low level (see Table 3.3). This can 
be attributed to government policies of en- 
couraging pupils to persist in school up to 
the end of the first or compulsory cycle. 
Senior-cycle secondary-school examinations 
are generally much more expensive for stu- 
dents than those offered at ti\e end of junior 
cycle. Candidates for examinations offered 
by overseas examination boards or syndi- 
cates are required to pay high fees. The fee 
for the senior-cycle terminal examination in 
Lesotho ($124.19) represents considerably 
more than the mean monthly income per 
capita in the country. 

Fees do not cover costs. In Kenya, for 
example, although the National Examina- 
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Table 3.3 

CANDIDATE FEES FOR PUBLIC EXAMINATIONS 



Countries/ 
linguistic 
status 



Scale 



Anglophone 

Kenya 
Lesotho 

Mauritius 
Swaziland 



Uganda 
Zambia 



KCPE - $3.54; KCSE $42.49 (minin\um) 
PSLCE-$1.86; JCE - c. $32.09; Senior Cert/COSC - 
c. $124.19 

CPE - none; Second level examinations - $67.00 average 
PC - $1 .25 per subject; JCE - Reg. fee - $3.33 + . 
$2.92 per subject; COSC - Registration fee - $13.13 + $11.46 
per subject 

PLE - $1.71; UCE - $13.14 (8 subjects); UACE 

- $13.43 (3 principal, 1 subsidiary subject) 

None - G7 and G9 (except external); SC - $12.87 (8 subjects) 



Francophone 
Chad 
Guinea 
Madagascar 
Mauritania 
Rwanda 

Togo 



No fee 
No fee 

CFEPCES - $0.19; Bac- $1.58 
NA 

None apart from Examm de reclassement andLe Jury 
Central -$12.53 

CEPD - $0.36; BEPC - $1.80; Bad - $7.30; 
Bad $12.90 



Other 

Cape Verde 



Ethiopia 



Basic elementary - none; Basic complementary - 
$2.20; General secondary - $10.20; Complementary 
Secondary - $2.00 per subject 

Grade 6 - none; Grade 8 - none; ESLCE - Gov. schools 
free; Others: Registration fee - $2.50 + $2.00 per paper 



tions Council effects considerable efficiencies 
through computer-scoring its primary leav- 
ing examination, its income from fees for the 
examination represents less than 50 percent 
of the total cost. In Uganda, the ratios of 
unit costs to unit fee for the three major pub- 
lic examinations are 1.34:1 for the PCE, 1.42:1 
for the UCE, and 1.44:1 for the UACE. 



Security 

A marked feature of public examinations 
in Africa is the pronounced emphasis on se- 
curity. The security dimension is empha- 
sized throughout all stages of the examina- 
tion process: setting questions, printing, 
proofing, packaging, distribution, supervi- 
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sion, and correction. The security emphasis 
simply reflects the importance of examina- 
tion success in the lives of students and their 
families. Success offers some hope of secur- 
ing valued scarce employment or of advanc- 
ing to the next highest educational level. Fail- 
ure, on the other hand, can lead to a rela- 
tively frugal existence or at best a lost year 
devoted to preparing for the same examina- 
tion. 

Commentators have noted "\he ease with 
which malpractices can occur" (Kelly 1986, 
p. 552). In Togo and Madagascar, concern 
has been expressed that security is not well 
maintained. In Zambia in 1980, it was re- 
ported that candidates in three regions re- 
ceived help from invigilators during the GCE. 
Copying has been a problem in Ethiopia. Col- 
lusion between candidates and supervisors, 
though rare, has been reported in Swaziland. 
Premature opening of envelopes containing 
examination papers has been noted in 
Rwanda. In Uganda, types of examination 
irregularities reported include leakage, im- 
personation, external assistance, smuggling, 
copying, collusion, and substitution (Ongom 
1990). 

In general, however, examination authori- 
ties are confident their security precautions 
are effective. Machine scoring appears to 
contribute to test security because it reduces 
the personnel requirement for scoring. Con- 
cern has been expressed, however, that due 
to the development of sophisticated devices, 
the security of machine-scored data is by no 
means guaranteed. In Ethiopia, the typing of 
Grade 6 and Grade 8 examinations is en- 
trusted to one typist. In many countries, 
people entering and leaving centres in which 
examination papers are printed are searched. 
Supervisors in Zambia must take an oath of 
secrecy. Similarly, employees of the Kenyan 
National Exanrination Council sign docu- 
ments binding them to the terms of the Offi- 
cial Secrets Act. Papers for examinations in 
Kenya are printed in the United Kingdom 
due to the absence of secure local printing 
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facilities. Elsewhere, papers are printed in 
secure premises, often as near as practical to 
the date of the examination to avoid unnec- 
essary storage problems or security breaches. 
Distribution of papers is undertaken under 
secure conditions. 

Some systems use identification numbers 
to ensure that markers do not have access to 
candidates' names. In the case of oral exami- 
nations, care is taken to ensure that candi- 
dates do not hear the questions beforehand 
or come in contact with others who have 
heard the questions. When there is evidence 
of misconduct at an examination centre in 
Uganda, the entire examination may be can- 
celled. In Kenya, serious malpractice in rela- 
tion to the conduct of an examination can 
lead to a lengthy prison term. 

Feedback 

Public examinations can be used to pro- 
vide feedback to teachers, curriculum bod- 
ies, and educational policymakers. Several 
of the countries in our review provide some 
kind of mechanism to make information on 
examinations available to interested parties. 

Past examination papers are important 
sources of information in some countries and 
considerable use is made of them in schools. 
Such papers, however, are not available ev- 
erywhere, such as in Lesotho. The wide- 
spread involvement of teachers from various 
parts of the country in item-writing, for ex- 
ample in Lesotho, has also been an important 
source of information to schools about the 
skills and knowledge tested in examinations. 

Comparisons among Schools/Districts 

Another source of feedback provided by 
examination authorities is the publication of 
the examination results of students on a 
school-by-school or district-by-district basis 
(Ethiopia, Kenya, Rwanda, and Swaziland). 
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Analysis of Results 

Some examination systems have devoted 
resources to providing detailed analyses of 
students' performance on public examina- 
tions. For example, in Lesotho, the test items 
for the primary-school mathematics exami- 
nation, together with performance item sta- 
tistics for the population of examination can- 
didates, was sent to all schools. Item-analy- 
sis information has also been prepared in 
Ethiopia, but the information was given only 
to Ministry of Education or Examination 
Board personnel. Countries in which item- 
anaiysis data have been used for post-ex- 
amination reports are Kenya, Mauritius, and 
Swaziland. Chief Examiners may also pro- 
vide descriptive reports on the overall per- 
formance of students on individual exami- 
nations and even on individual examination 
questions. In some countries, such as Zam- 
bia, every school receives a copy of the Chief 
Examiner's Report. 

Information about examination perfor- 
mance can be helpful in identifying aspects 
of the curriculum that appear to have been 
poorly taught or ignored by teachers. We 
might expect the information to contribute 
to improvement in the construction of ex- 
aminations and in future examination per- 
formance. 

The KCPE Newsletter published by the 
Kenyan National Examinations Council is 
an example of a systematic approach to- 
wards informing teachers about how stu- 
dents have perlormed on examinations, The 
newsletter, which is circulated to all schools, 
contains item-analysis data for each exami- 
nation paper. It also includes suggestions 
as to why students may have selected par- 
ticular incorrect options. Examples of poor, 
average, and good answers to selected ques- 
tions are presented and teaching implica- 
tions are described. Teachers make frequent 
use of the information provided in the News- 
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letter in their classes. For example, they 
analyze with their students the characteris- 
tics of "good" and "poor" essays presented 
in the newsletter. 

Timeliness 

Prompt release of examination results is 
necessary to allow for appropriate planning 
by schools and individuals. Results returned 
after the conunencement of the new school 
year represent an inefficiency, as they clearly 
delay tlie assignment of pupils to appropri- 
ate classes. The lag between the time the 
examination is given and the formal publi- 
cation of results depends on the efficiency 
of collection procedures and the size of tiie 
examination enterprise. 

Even within countries, the tir.ieliness of 
feedback varies from one examination to the 
next. Evidence from Chad suggests that the 
results of the CEPE and the Baccalauriat are 
available as soon as one week after the ex- 
amination while Grade 6 concours results 
may take up to three months to be pub- 
lished. 

A disadvantage associated with the Ke- 
nya KCPE Newsletter is that it does not ap- 
pear until the final term of the year follow- 
ing the examination, thereby lessening the 
potential value of its feedback for teachers. 
Since, however, curriculum content tends to 
remain constant over the years, the overall 
utility of the newsletter is probably not se- 
riously diminished. 

Challenges to Examination Results 

A number of examination bodies permit 
appeal of examination results. In both Le- 
sotho and Swaziland, appeals are allowed, 
on payment of a fee, for a period of six weeks 
following the publication of the primary and 
junior-cycle results. In Lesotho, if the ap- 
peal is successful, the candidate is refunded 
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half the fee. Ethiopian authorities discour- 
age appeals, claiming that the process is both 
expensive and time-consuming, but the 
Board does recheck results. Appeals in Zani- 
bia must be subnutted through the princi- 
pal teacher; recheck fees are not charged. 
Similarly, in Swaziland, requests for 
rechecking the results of the Cambridge 
Overseas School Certificate Examination 
must be made through the principal. In this 
instance, the examination authorities do little 
to encourage candidates to seek a recheck. 
It is stressed in an explanatory note that re- 
ports will be limited to one subject per school 
on any one occasion of the examination and 
to the work of not more than six candidates 
in that subject. The service is not made 
available to private school candidates. 



Outside-School Tuition 

As happens elsewhere throughout the 
world, students in examination classes fre- 
quently seek additional academic help out- 
side of school or in tuition offered in schools 
outside of regular school hours. The empha- 
sis on private tuition is particularly pro- 
nounced in Mauritius. One study reported 
that 73 percent of Standard 6 pupils in the 
primary school-leaving examination class 
took private tuition. As many as 11 percent 
of Standard 1 pupils also took private tu- 
ition. Tuition frequently was provided in 
groups of twenty-five or more. Approxi- 
mately 60 percent of secondary-school stud- 
ents also enrolled in tuition groups 
(Joywathsing and others 1988). 
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5 Issues in Examination and Assessment 



In this chapter, we consider trends that 
appear in the examination systems of at least 
some of the countries included in this study 
and outline issues to which education au- 
thorities might direct their attention when 
considering possible areas for reform in as- 
sessment and examination procedures. 

In considering these issues, sight should 
not be lost of the fact that considerable differ- 
ences exist between the examination systems 
of the fourteen covmtries described in this 
report. In highlighting issues, one can easily 
give the impression that contextual factors 
that operate in the individual countries are 
less important than they actually are (see 
Little 1990). Of obvious importance are dif- 
ferences in the educational systems of the 
countries. For example, there are differences 
in the numbers of students who are retained 
at varying levels and dif ferences in the use of 
a vernacular language for instruction. Both 
have implications for the assessment of learn- 
ing. Among the differences in examination 
systems are differences in traditions, not only 
in the colonial period but also in the post- 
independence period, which reflect consid- 
erable diversity in the way in which national 
systems of examinations have developed 
(Eisemon 1990). Examination systems also 
differ greatly in the use of technology , for 
example, in the use of computers and opti- 
cal-mark readers. Such differences have im- 
plications that go beyond the technology. For 
example, they affect the types of items used 
in examinations, methods of marking, costs, 
and the ease with which information on ex- 
amination performance can be provided to a 
variety of publics. 



Expanding Enrollments 

Perhaps the most obvious trend in the 
development of examinations in recent years 
in many of the countries studied for this 
report, has been the enormous increase in 
the numbers of students sitting for exami- 
nations. For example, between 1968 and 
1988, Swaziland registered an increase of 
over 200 percent in numbers taking its pri- 
mary-certificate examination and an increase 
of over 1,000 percent in the numbers taking 
the junior-secondary school-certificate ex- 
amination. In Ethiopia, over a much shorter 
time span (1979-87), primary-certificate can- 
didates have shown a 240 percent increase, 
junior-secondary certificate candidates a 260 
percent increase, and senior-secondary cer- 
tificate candidates a 400 percent increase. In 
general, the higher the level of the examina- 
tion, the greater has been the rate of increase. 

As we noted in Chapter 1, increases in 
the numbers taking examinations, as well 
as in enrollments generally, have been asso- 
ciated in people's minds with declining stan- 
dards in education. This has been particu- 
larly so when resources to deal with this 
expansion have not been available. The 
increased numbers have also forced a re- 
consideration of the content of curricula in 
schools. An academic type of curriculum, 
which might have been suitable when ac- 
cess to educatica was limited, is not likely 
to be suitable when all or most of the popu- 
lation attend school. Curriculum change has 
obvious implications for the nature of ex- 
aminations, implications that relate not just 
to content but to function. It is increasingly 
recognized that the dominant selective func- 
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tion of examinations must give ground to 
the certification function. Just as curricu- 
lum change has implications for examina- 
tions, examinations may have implications 
for curriculum. For this reason, changes are 
being introduced to the examinations of 
several countries, including content and 
skills appropriate to the wider range of 
achievements, needs, and interests repre- 
sented in the growing numbers of students 
taking examinations, to stimulate beneficial 
effect on curricular practice in schools. 

Expanding enrollments ivill continue to he a 
pm'ssin^i issue for many examination systems, 
for educational authorities they will ^ead to a 
demand for greater resources and to changts both 
in the content and ftinction of public examina- 
tions. 

Resources for Examinations 

Examination authorities appear to devote 
virtually all of their time and resources to 
the administration of the national examina- 
tions. Frequently they are understaffed. 
With a few notable exceptions, relatively 
little or no time is given to systematic analy- 
ses to improve examination quality. Indeed, 
most authorities do not have the research 
capability to undertake this task. Fre- 
quently, skilled personnel are not available 
within the country. In a number of in- 
stances, however, people with formal train- 
ing in psychometric techniques have been 
assigned to other sectors within education 
ministries. In Zambia, staff shortages within 
the Examinations Council have resulted in 
members of its Department of Research and 
Test Development having to devote most of 
their time to item-writing and pretesting. 

In general those responsible for the con- 
struction of examinations have had little or 
no relevant formal training. Many, of 
course, acquire skills through experience. 
However, weaknesses could be avoided if 
adequate training facilities were available. 
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According to one national report (Ethiopia), 
...among the weaknesses observed in 
some papers were unclear instruc- 
tions, poor grammar, placing of ques- 
tions som pages from the passage 
on which they are based, use of in- 
terrelated questions, (for example, 
the stem of a question prompts the 
answer to an earlier question), and 
inadequate supporting art work" (p. 
40). 

Governments and examination bodies will 
have to address the issues raised by staff short- 
ages and lack of trained personnel. 

Effects of Examinations on Curriculiun 
and Teaching 

We have already noted in Chapter 1 that 
whenever the results of external examina- 
tions are an important determinant of fu- 
ture education and life chances or are used 
to evaluate teachers, the examinations will 
be taken very seriously by teachers and stu- 
dents. In this situation, teachers pay par- 
ticular attention to the "tradition of past 
examinations." Having identified the con- 
tent and skills covered ixi pr«^vious exami- 
nation questions, they coach stuJents in the 
identified content and skills. This :an have 
positive effects on curriculum. For example, 
in Lesotho, the marks (25.0 percent) in the 
Junior-Certificate Examination awarded for 
practicals help to ensure that this aspect of 
the curriculum is covered throughout the 
school year. In Kenya, by including items 
that relate to local conditions and that at- 
tempt to measure higher-order cognitive 
skills in the KCPE, the Kenyan National Ex- 
aminations Council has drawn teachers' at- 
tention to a new range of knowledge and 
skills. 

However, when people talk about the 
"tradition of past examinations" defining 
curriculum in schools, very often they are 
referring to negative effects of this tradition. 
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What they mean is that teachers are prob- 
ably spending inordinate time in simply 
working for the certifying tests, often at the 
expense of subjects and skills not tested in 
the examination. 

The narrowing effects of the public ex- 
aminations on curriculum have been com- 
mented on in most of the national reports 
and reinforce the findings of research in a 
variety of countries relating to the effects of 
examinations that we outlined in Chapter 1. 
In Ethiopia, curriculum areas that tend to 
receive relatively little attention in the class- 
room include writing, vocational, oral and 
aural skills, use of reference material, and 
practical work in science. In Madagascar, 
subjects such as music and physical educa- 
tion, which are not examined, tend not to be 
taught in primary schools. In Zambia, local 
languages, practical subjects, and production 
activities are not formally examined and con- 
sequently are undervalued in schools. In 
Zambia as well as in Ethiopia, where the 
primary school-leaving examinations are 
limited to multiple-choice items, writing 
skills receive inadequate attention. In Cape 
Verde, the status of subjects such as visual 
education, handicraft, and physical educa- 
tion is diminished as these are not tested 
when ascertaining who is to be promoted. 
The Mauritius report observed that the 
highly competitive Certificate of Primary 
Education Examination has led to "a neglect 
of broader curriculum goals not included in 
the CPE syllabus ' (p. 34). 

The importance of examination results 
for the pupil and for the teacher is reflected 
in the amount of time spent fostering test- 
taking strategies. A recent report from 
Uganda observed that "the system is so 
exam ridden that the entire teaching and 
learning is geared to passing the exam and 
getting the good marks needed for entry to 
higher levels of education" (Uganda, Minis- 
try of Education 1989, p. 7). In Zambia, 
"even against their better pre ^^essional judg- 
ment," teachers feel compelled to direct their 
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efforts to obtaining good examination re- 
sults, "out of a concern for their pupils, and 
to safeguard their own reputations" (Kelly, 
Nkwanga, Achola, Kaluba, and Nilsson 
1986, p. 551). Teachers in Cape Verde make 
extensive use of the examination papers 
from previous years; virtually all of the time 
spent in school is devoted to preparing stu- 
dents for examinations. Practice in exami- 
nation-taking techniques is also a feature of 
primary education in Mauritius and Mauri- 
tania. In Ethiopia and Madagascar, routine 
classroom examinations reflect closely the 
item types used in the official examination. 
Teachers in Ethiopia and Kenya use the mul- 
tiple-choice format of the national examina- 
tion in their regular classroom tests as early 
as the junior primary grades. Indeed, teach- 
ers have been observed to use the multiple- 
choice format not only in examining but in 
teaching, as early as in the first grade. 

The amount of time teachers in a num- 
ber of Francophune countries are required 
to devote to formal assessment must of ne- 
cessity limit teaching time. For example, in 
Togo, Madagascar, and Guinea, teachers are 
expected to administer monthly, trimester, 
and end-of-year examinations. 

Examinations are often regarded as an 
important source of motivation and as en- 
couraging teachers and students to work 
hard. By targeting important elements of 
the curriculum, they can focus student learn- 
ing and may raise students' levels of achieve- 
ment. And success on a public examination 
is an achievement of significance not alone 
for students but also for parents and teach- 
ers. The significance of passing the Kenya 
CPE examination in the eyes of one young 
candidate is well portrayed in an essay writ- 
ten during the examination (Appendix 3). 

Evidence from a number of countries, 
such as Mauritania and Zambia, however, 
indicates that examinations tend to promote 
a passive co icept of learning. Furthermore, 
since scoring high marks in examinations 
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becomes the dominating, interest of pupils, 
"pupils who cannot secure places at the next 
educational level are stigmatized as failures. 
There is even some tendency to judge the 
personal worth of an individual on the ba- 
sis of his examination performance" (Kelly 
1986, p. 26). 

Examination authorities must take into ac- 
count that while motivating students and teach- 
ers, important public examinations also help to 
ensure that curriculum content likely to be tested 
will be covered by teachers; that subjects that 
are not tested tend to receive relatively little 
teaching emphasis; that considerable class time 
is devoted to fostering test-taking strategies; and 
that passive concepts of learning are promoted. 
In addition, society at large and, in particular, 
pupils themselves frequently equate examination 
performance with personal worth. 

Reducing the Burden of Examinations and 
Introducing School-based Assessment 

In a number of countries, efforts are be- 
ing made to reduce the burden of examina- 
tions. Three broad strategies to achieve this 
can be identified, although it is not usually 
clear in the case of individual countries what 
strategy will eventually be adopted. 

One strategy involves the reduction of 
the number of public examinations through 
the abolition of examinations and certifica- 
tion at particular points in the educational 
system. For example, in Kenya, public ex- 
aminations and certification no longer oc- 
cur at the end of the junior cycle of second- 
ary schools, while other countries (Cape 
Verde, Ethiopia, Guinea) plan to reduce the 
number of their examinations. 

In the second strategy, procedures are 
already in place or proposals exist to allo- 
cate a percentage of public-examination 
marks on the basis of school-based assess- 
ment. The school-based assessment could 
be used in areas in which a terminal exter- 
nal examination is inappropriate, for ex- 
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ample in the assessment of practical or 
project work, or it could be more general 
and overlap with elements of the external 
assessment. 

Examinations in Ethiopia (at the primary 
level) and in Lesotho (at the junior-second- 
ary level) already have elements of school- 
based assessment. There is also a definite 
commitment in a number of countries (Le- 
sotho, Swaziland, Uganda, Zambia) to make 
school-based assessment an important fea- 
ture of public examinations. However, this 
is being done with caution. For example, in 
Zambia, the recommendation is that continu- 
ous assessment in the public-examination 
system should be confined to performance 
in practical subjects (Zambia, Ministry of 
Education 1977). A recent report in Uganda 
contained a strong recommendation that 
school-based continuous assessment should 
account for 20 percent of the marks allo- 
cated for each subject in the primary school- 
leaving examination (Uganda, Ministry of 
Education 1989). The assessment, which 
would be moderated by the school 
inspectorate and officials of the Uganda Na- 
tional Examinations Board, would include 
assessment of performance in class, of par- 
ticipation in community projects, and of cre- 
ative activities. In Swaziland, it is hoped 
that school-based assessment will eventually 
receive a weighting of 50 percent of the to- 
tal mark in the primary-certificate examina- 
tion. 

A third possible strategy is to base certi- 
fication entirely on school-based assessment. 
This is not envisaged in any counti/ in our 
study in the immediate future. 

Arguments can be advanced in favor of 
and against school-based assessment 
(Heyneman 1988; Pennycuick 1990). Argu- 
ments in favor go as follows: 

•Since assessment by teachers is a cru- 
cial component of good learning and 
teaching, every effort should be made 
to improve teachers' competence in this 
area (Crooks 1988). If school-based as- 



sessment becomes part of the certifica- 
tion process, it is likely that greater ef- 
fort will be invested in improving 
teachers' general competence in assess- 
men,:, and this should have beneficial 
effects on teaching and learning. 

• School-based assessment provides 
immediate feedback information to 
teachers on student achievement and 
teaching effectiveness. 

• Since school-based assessment is car- 
ried out over time and by a person who 
knows students well, it is likely to pro- 
vide a more valid and reliable ap- 
praisal of a student's achievements 
than can a single external terminal 
examination. In this context, one com- 
mentator in Zambia has observed that 
the school is "the only place where 
there is enough information to do rea- 
sonable justice to a pupil" (Kelly 1986, 
p. 20). 

• School-based assessment permits an 
extension of the range of curriculum 
topics which are examined. The present 
system of examinations limits the range 
of achievements that can be assessed 
and must narrow the curriculum in 
schools. Aspects of achievement that 
cannot be satisfactorily assessed in a 
terminal examination include a 
student's ability to plan and organize 
a project and persevere with it over 
time. While the assessment of oral and 
practical skills may be carried out in a 
terminal examination, inevitably it will 
be limited, artificial, and expensive. 

• School-based assessment reduces the 
undesirable back-wash effects of exter- 
nal examinations. 

• School-based assessment, if spread 
over the year, can increase the level of 
pupil motivation and application 
throughout the year. 

Some of the following arguments ad- 
vanced against the use of school-based as- 
sessment in the certification of students: 

• Its use can change the nature of the 



relationship between teachers and stu- 
dents towards making the judicial as- 
pect of the teacher's role more promi- 
nent. 

• Marking standards in school-based 
assessment are likely to vary both 
within and amcng schools. While 
moderation procedures can help, they 
tend to be expensive. 

• School-based assessment can subject 
teachers to considerable parental pres- 
sure, especially during the periods 
leading up to and immediately after 
critical public examinations. 

• School-based assessment would re- 
quire teachers to devote more time to 
assessment and recording. 

• School-based assessment gives rise 
to a variety of administrative problems 
for schools, such as what to do when 
students are absent for tests or when 
students transfer from one school to 
another. 

• Teachers' assessments are subject to 
a variety of biases. 

• In many instances, it is difficult if 
not impossible to apply school-based 
assessment to non-school-based candi- 
dates. 

Such considerations led the participants 
in a conference on school-based assessment 
in Swaziland to conclude that if such as- 
sessment is to be used in combination with 
external-examination results in the final 
national summative assessment of students, 
a number of conditions should be fulfilled 
to at least mitigate, if not completely remove, 
the problems to which its use is likely to 
give rise. First, national item banks of tests 
should be available to teachers. Second, 
clear guidelines for assessment should be 
provided. Third, procedures for recording 
and interpreting should be common to all 
schools. And fourth, standards betv/een 
schools "should be controlled statistically" 
and should be moderated and controlled by 
school inspection (Swaziland, Ministry of 
Education 1987). 
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Clearly advantages and disadvantages are 
associated with both school-based assessment 
and external examinations. Individual coun- 
tries should consider the appropriateness of 
these procedures for the conditions in which 
their educational systems operate — the pres- 
sure for selection, the level of training of 
teachers, and the availability of resources to 
support either a school-based or external sys- 
tem of assessment. When selection is an im- 
portant issue, any consideration of a system 
in which teacher assessments are a basis for 
important decisions about students must rec- 
ognize that the assessments should not only 
be accurate but should be perceived to be so. 
To achieve this situation, teachers would re- 
quire the support of a high level of training 
and a range of services, including guidance 
and secretarial support. In many countries 
outside Africa in which school-based assess- 
ment is used, teachers also have available a 
range of aptitude and achievement tests that 
can be used to set objectives, to monitor stan- 
dards, and to provide a basis for student guid- 
ance. The problems that can arise when 
school-based assessment is introduced into a 
system in which classes are large and the nec- 
essary resources are not provided have been 
documented in Lesotho (Sebatane 1985) and 
in Nigeria (Ali and Akubue 1988). 

The issue of school-based assessment is a 
very live one in many countries. As educa- 
tional systems develop and expand and as the 
pressure for selection eases, we may expect a 
decline in the need for external examinations. 
Countries will reach that point at different 
dates. As they work towards li, investment 
in the development of the required infrastruc- 
ture for an effective system of school-based 
assessment (including teacher training) 
should have the short-term effect of improv- 
ing the quality of assessment and instruction 
in schools. 

Consideration should be given to increasing 
the role of school-based assessment. This will re- 



quire extensive pre-service and in-service teacher- 
training programs as well as other resources. 

Use of Multiple-Choice Tests and Their 
Associated Technology 

Partly as a result c f the growth in the num- 
bers of students taking examinations, there 
has been an increase in many countries in the 
use of objective multiple-choice tests. In our 
study, half the countries used such tests in 
their primary-school certificate examinations. 
Such tests are cheaper to score when large 
numbers of candidates are involved. They are 
likely to be more reliable and to provide 
broader curriculum coverage than essay tests. 
They also make the provision of feedback on 
student performance easier. Related to the 
use of objective tests has been the growth in 
pretesting of items, in mechanical marking, 
and in the use of computers to process results. 
Despite the apparent advantages of these pro- 
cedures, the use of objective tests and the tech- 
nology usually associated with them, some of 
which can be applied to more traditional 
kinds of examinations, can cause a number of 
problems. 

The first problem arises from the fact that 
the selective role of examinations may be re- 
inforced by the introduction of computer 
technology and the ease with which statisti- 
cal procedures can be used to standardize 
marks and determine cut-off points for grades 
on the basis of the number of students obtain- 
ing certain scores. This can happen both with 
examinations that use multiple-choice tests 
and ones that do not. 

A second problem is that the new proce- 
dures, especially the selection of items that 
have high indices of discrimination for mul- 
tiple-choice tests, tend to reinforce the view 
that the latent-trait model of classical psycho- 
metric theory adequately represents the 
school achievements of students. The as- 
sumptions on which this approach is based — 
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that when many discrete behaviors co-vary, 
they hav^ a single underlying detenninant; of 
which individuals possess varying 
amounts— can be challenged even in the case 
of western students (Christie and Forrest 
1981). Their validity is more doubtful in the 
case of students who live in two cultural 
worlds, with all that implies in terms of lan- 
guage use, modes of cognitive functioning, 
and methods of learning (Kellaghan 1961, 
1968). 

Rigid adherence to a policy of discarding 
items with low item-test correlations runs the 
risk of eliminating items that prove to be ei- 
ther very easy or very difficult (Greaney 
1980). Thus, the routine discarding of items 
that have low correlations with the total test 
score also runs the risk of making the test less 
representative of the defined universe 
(Cronbach 1971; Kwasna 1974; Quansah 
1985). 

A further problem arises from the fact that 
the introduction of the new technical devel- 
opments led in some countries to dropping 
essay examinations and to a heavy reliance on 
multiple-choice tests. An examination sys- 
tem made up only of multiple-choice items 
has several disadvantages. For one thing, it 
cannot measure some of the outputs of edu- 
cation that most people would regard as im- 
portant, such as oral and practical skills, in- 
cluding the ability to write continuous prose. 
Further, multiple-choice tests are most effi- 
cient in measuring recall and recognition of 
factual information; it is extremely difficult to 
construct such tests to measure higher-order 
skills. Limiting an examination to multiple- 
choice items is likely to have undesirable ef- 
fects on what goes on in schools since, in pre- 
paring students for the examination, the 
temptation will be to pay little attention to 
skills other than those which can be measured 
by the test. If higher-order and writing skills 
do not form part of public examinations, they 
are not likely to receive the attention they 
should in schools. 



Examination authorities should be sensitive to 
the fact that while multiple-choice tests offer the 
benefits of efficiency, test reliability, and potential 
for feedback to teachers, they are subject to a num- 
ber of serious limitations. These include unduly 
arbitrary use of standardized marking schemes 
and cut-off scores attributable to the ready avail- 
ability of computers, an assumption of a unitary 
achievement trait, psychometric procedures that 
reduce the content validity of a test and the neglect 
of important educational skills not amenable to 
multiple-choice test assessments. Since decisions 
about students are likely to be more valid and fair 
when based on multiple sources of information, in- 
sofar as it is feasible, candidates should be required 
to demonstrate their knowledge and skills in a va- 
riety of contexts. 

Validity 

Validity is concerned with the appropri- 
ateness of desCTiptions, inferences, classifica- 
tions, or decisions that are made on the basis 
of examination results. As far as curriculum 
validity is concerned, the responsibility for 
determining ^hat questions in public exami- 
nations reflect adequately the official curricu- 
lum rests ultimately with the body entrusted 
with the operation of the examination system. 
If an examination is to possess curriculum va- 
lidity, individual questions should represent 
a balanced and adequate sampling of the cur- 
riculum course. While some systems, such as 
in Swaziland, take the precaution of using 
moderators to establish the extent to which 
the elements of the prescribed curriculum are 
covered, others, for example Madagascar and 
Togo, simply select questions from lists sub- 
mitted by teachers. 

Pai t of the reason for the lack of adequate 
curriculum coverage in examinations is that 
student selection is a major function of the 
examinations. An examination can be an 
efficient selection instrument even if large 
sections of a curriculum are excluded from 
it. Further, since an examination designed 
for selection will have as a major interest 
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disCTimination between students close to the 
cut-off point for selection, questions in- 
cluded may be too difficult for the general 
body of candidates, something that is borne 
out by the poor level of student performance 
on many public examinations in Africa. 

Despite the emphasis on selection in pub- 
lic examinations, study of the predictive va- 
lidity of performance on the examinations 
has received little attention. The limited 
available evidence is not very encouraging. 
In one study in Ethiopia, students' perfor- 
mance on the ESLCE mathematics exami- 
nation did not predict success in first-year 
mathematics in the university (Asmerson 
and others 1989). A somewhat similar study 
conducted by the University of Zambia con- 
cluded that the low predictive validity of 
examinations rendered their use for selec- 
tion at all levels problematic (Kelly and oth- 
ers 1986). 

Attempts have been made in a number 
of countries to improve aspects of the valid- 
ity of examinations. One such attempt in- 
volves the pretesting of items used in mul- 
tiple-choice tests, a device that, it might be 
argued, should improve curricular validity. 
However, pretesting may not have this ef- 
fect (Madaus, Airasian, and Kellaghan 1980). 
Selection of items of intermediate levels of 
difficulty for the final test, like the use of 
high discrimination indices, runs the risk of 
making a test unrepresentative of the de- 
fined universe. Such a practice is more likely 
to contribute to instructional validity (what 
is taught in schools) than to curricular va- 
lidity (what is laid down in the curriculum), 
since only items that a given proportion of 
pupils (about half) get right will be retained 
in the test. Thus, only items pupils have 
had the opportunity to learn (presumably 
in school) will find their way into the test. 
If schools consistently ignore aspects of the 
curriculum, items relating to those aspects 
will not be included in the test, creating a 
situation in which certain curriculum areas 
are not tested (Kellaghan 1990). 
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However, discarding items that do not 
exhibit intermediate levels of difficulty will 
also affect a tesf s instructional validity since 
material that is well taught will be excluded 
from the test. It \s thus important that de- 
cisions to include items in a test should not 
be based on the common practice of select- 
ing only items of intermediate level of dif- 
ficulty, which will maximize a test's ability 
to discriminate between student perfor- 
mances, but, at the same time, will reduce 
its curricular and instructional validities. 

An alternative to norm-referenced stan- 
dardized tests was proposed in the Mauri- 
tius report. It suggested that a pass should 
be redefined in terms of essential compe- 
tencies for primary-school graduates rather 
than in terms of standardized scores. Each 
letter griide would be defined in criterion- 
rather than in norm-referenced terms, and 
grades would indicate the performance lev- 
els of students. The approach would also 
have the advantage of lending itself more 
than norm-referenced procedures to the 
monitoring of changes in achievement stan- 
dards over time. Since a criterion-referenced 
approach might not adequately serve the se- 
lection function of the examination, the Mau- 
ritius report goes on to recommend that stu- 
dents in the top grades, such as A and B, be 
ranked for selection purposes. While the 
proposal has much to recommend it, the dif- 
ficulties of specifying essential competencies 
should not be underestimated. 

A body responsible for the construction of 
examinations has a clear obligation to attend to 
validity issues. In this, the need to achieve bal- 
ance between the certification and selection func- 
tions of the examinations must be kept in mind. 
The examinations body should ensure that the 
procedures it uses in the construction of exami- 
nations are more likely to contribute to, than to 
interfere with, the examination's validity. If ex- 
aminations are used for selection, the examina- 
tion body should accumulate evidence to show 
how well performance on examinations reflects 
real-life educational performance. 
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Accountability 

Examination results are sometimes used 
as a measure of school effectiveness. When 
this occurs, teachers and others tend to be 
held accountable for the performance levels 
of students. Frequently, successful perfor- 
mance is equated with the percentage of can- 
didates who advance to the next highest 
level of the educational system. 

In Kenya, national and provincial 
rankings of schools based on public exami- 
nations are published annually to provide 
the public with an opportunity of compar- 
ing schools. In districts that occupy the 
lower end of the merit order, teachers may 
be accused of being lax, administrators of 
not performing their supervisory duties, and 
parents of not being "development-minded" 
(Oloo 1990). Zambian teachers also tend to 
be blamed if too few of their pupils are se- 
lected on the basis of examination results 
for further schooling. "Good" teachers in 
the Prai region of Cape Verde are those who 
attain a promotion rate of 50 percent at the 
end of the school year. Examination perfor- 
mance is used by the Ministry of Education 
in Swaziland and by the general public as a 
measure of school effectiveness. In Lesotho 
also, examinations serve an accountability 
function; teachers and schools with high 
examination marks are usually regarded as 
"good." In Uganda, where most of the 
school fees are paid by parents, examina- 
tion results can have a fairly rapid impact; 
"good" results tend to increase the pressure 
for school places. 

The ranking of school districts or schools 
is more complicated than current practice 
would seem to acknowledge. In fact, infer- 
ences made about the "effectiveness" of 



schools or districts on the basis of rankings 
may be inaccurate and unfair. First, it has 
been shown in the United States that rank- 
ings can vary greatly depending on the 
school outcome that is used (Guskey and 
Kifer 1990). Second, comparisons between 
schools on the basis of examination results 
generally fail to take into consideration the 
social or even physical conditions under 
which schools operate. However, if statisti- 
cal adjustments to school outcomes are made 
on the basis of student characteristics and 
their backgrounds, level of teacher qualifi- 
cation, and availability of material resources, 
a very different order of merit might emerge. 
Third, whether or not adjustments are made 
to school-output measures, errors in the mea- 
surements on which rankings are based are 
not likely to be taken into account when 
judgments of merit are being made about 
schools. For example, will observers know 
that the difference between a rank, say, of 
35 and one of 38 may only be a matter of 
chance? Finally, in cases in that parents or 
students have a choice of school, the publi- 
cation of results may lead to schools that 
are perceived to be doing well to attract stu- 
dents of high levels of scholastic ability, 
aspiration, motivation, and parental support 
while those that are perceived to be doing 
badly, even though they may be more "ef- 
fective" than schools with better results, will 
be avoided by such students. This situation 
in time could lead to low morale in indi- 
vidual schools and to a ghettoization of the 
school system. 

The effects on schools of using examination 
results as an accountability mechanism demands 
immediate attention from education authorities. 
In particular attention should be directed to the 
identification of "successful" and "failing" 
schools and teachers on the basis of examination 
results and to the publication of school rankings. 



47 



Language of Examination 

In thirteen of the fourteen countries in 
our study for which data were available, 
there was an average of 4.7 principal lan- 
guages (i.e., indigenous languages spoken 
by at least 10 percent of a country's popula- 
tion and any other language that serves as 
an official language, lingua franca, or me- 
dium of instruction) (World Bank 1988, Table 
B-12). 

This situation creates serious problems re- 
lating to language of instruction and language 
of examinations. Countries have adopted a 
variety of strategies to deal with the situation 
and, in some cases, have changed these strat- 
egies over time. The most common practice 
is to use a local language for instruction in 
the early grades of primary school. In some 
countries, the relevant international language 
(French or English) is also used at this stage. 
The medium of instruction in the higher 
grades of primary schooling in most countiies 
is officially either French or English. In all 
countries, French or English is the medium 
of instruction in secondary schools, except in 
Cape Verde, where it is Portuguese. In some 
countries, some schools also provide instruc- 
tion in an alternative language, for example, 
Arabic in Mauritania. In all cases, with the 
obvious exception of language subjects, the 
language of examinations is the same as the 
official language of instruction. 

For the majority of pupils in the countries 
in our study, the language used in instruc- 
tion and in examinations (English or French) 
was not their mother tongue. We know rela- 
tively little about the difficulties that African 
students experience in the acquisition of a sec- 
ond language or about how education 
through the medium of a second language 
affects the quality of that education. Not sur- 
prisingly, some commentators have attrib- 
uted low levels of achievement in public ex- 
aminations to the language difficulties of stu- 
dents (Eisemon 1990). In Mauritius, for ex- 
ample, where the lingua franca is Creole, some 
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candidates' poor examination performances 
is due to a failure to understand questions set 
in English. The low pass rate (38.8 percent) 
recorded by Madagascar students in the 
Technical BaccalaurM has been attributed to 
the extensive use of French in the educational 
system. In Ethiopia, where English is the me- 
dium of instruction in secondary schools, it 
is accepted that there will be a move towards 
assessment in Amharic in the Grade 8 and 
ESLCE public examinations. 

The choice of language for examinations has 
to be considered in the wider context of choice of 
language of instruction. The decision is a diffi- 
cult one for many countries and requires contin- 
ued research, analysis, and review. 

Comparability of Performance 

Possession of a certificate, such as a pri- 
mary school-leaving certificate, would imply 
that students had attained an acceptable and 
comparable level of performance in defined 
achievement areas. Further, one might as- 
sume that the certificated students had ad- 
dressed themselves in examinations to the 
same tasks under similar conditions. How- 
ever, current practices in some countries re- 
lated to "compensation" raise a number of 
issues that suggest that these assumptions 
may not be tenable. Basically, the practice of 
compensation involves allowing credits or 
marks that a student has achieved in one cur- 
ricular area to make up for a relatively poor 
performance in another area. Questions ob- 
viously arise about the comparability of stu- 
dents' achievements when different achieve- 
ments are involved or when the achievements 
are measured in different way's. 

In Guinea adjustments are made to exami- 
nation marks to take into account the fact that 
some teachers may not have covered certain 
elements of the curriculum, again raising the 
issue of comparability of results. Cape Verde 
students are exempted from an oral exami- 
nation if they achieve a certain level of per- 
formance in the written test. In fact students 
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may gain exemption from each of the three 
national examinations on the strength of their 
performances on internal school-based ex- 
aminations. A Togo candidate who scores less 
than 10 but at least 9 out of 20 can compen- 
sate for this relatively low mark by taking an 
oral examination. In the Ethiopian Grade 6 
and Grade 8 examinations, it is possible to 
compensate for poor performance levels in 
certain subjects. For example, candidates 
who score poorly in Amharic, English, and 
mathematics, three important subjects at sub- 
sequent educational levels, can qualify for a 
certiiicate by moderate to good performance 
in political education, general science, and so- 
cial science. 

In Lesotho a first-class pass is awarded to 
primary certificate candidates who obtain a 
grade of at least 60 percent in English, 
Sesotho, and mathematics and at least 60 per- 
cent in the examination as a whole. To ob- 
tain a second-class pass, a grade of at least 50 
percent has to be obtained in these three sub- 
jects and at least 50 percent in the overall ex- 
amination. A third-class pass is awarded to 
candidates receiving 40 percent in any three 
subjects and also on aggregate. A student 
who obtains 90 percent in all subjects with the 
exception of, say, English, in which he or she 
gets 40 percent, would merit only a third-class 
pass. It could be argued that the overall per- 
formance of this candidate is superior to that 
of another who obtained a first-class pass by 
scoring 60 percent in all subjects. 

In these examples, it is often difficult to 
determine what possession of a formal cer- 
tificate means in terms of levels of scholastic 
achdevement since students' achievements are 
assessed in different ways. However, the use 
of different modes of assessment does not 
necessarily give rise to this problem. While 
it may have this effect, multiple measures of 
achievement can be useful in allowing a per- 
son to exhibit a particular skill, trait, or 
achievement. 



Examination bodies that use compensation 
procedures should ensure that these do not give 
rise to ambiguities in the interpretation of exami- 
nation performance. 

Quotas 

To meet social or political objectives, quo- 
tas are used in some countries, along with 
examination results, to control student flow 
to the next highest level. In effect, quota sys- 
tems guarantee that a certain number of can- 
didates from a particular category, who oth- 
erwise would not advance to the next level, 
do so. Where this happens, the success of 
these candidates occurs at the expense of 
other candidates who would have advanced 
had no quota system been in operation. 

Following the correction of the concours at 
the end of primary schooling, the Rwandan 
Ministry of Education selects students for sec- 
ondary schools, bearing in mind the need to 
have regional, ethnic, and gender balance. 
Mauritius also uses a gender quota; the top 
2,000 boys and 2,000 girls on the primary 
school-leaving examination are offered places 
in secondary school. Both Mauritania and 
Ethiopia set pass marks that vary from region 
to region. In Ethiopia, the selected passing 
raw score is transformed into a percentile 
rank derived from the distribution of aggre- 
gate scores for all candidates. Regional offic- 
ers are instructed to determine the passing 
raw scores for their regions by identifying the 
aggregate score that corresponds to the na- 
tionally selected passing percentile rank. The 
effect of this on the Grade 6 National Exami- 
nation in 1987 was that while the passing raw 
score in Eritrea was 42, in Gojam it was as 
high as 47. Thus, for many Ethiopian stu- 
dents, success or failure depended on place 
of residence. 

One effect of the operation of quota sys- 
tems is that students change their place of 
residence or their names to improve their 
chances of selection. 
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Tae quota system enables examination 
authoriUes to examine the predictive validity 
of selection procedures. To do this, ti\e sec- 
ondary-school performance of students who 
were selected on the basis of their examina- 
tion performance is compared with the per- 
formance of students who would not have 



been selected on their examination perfor- 
mance but gained entry to secondary school 
because of quota requirements. 

The social, political and educational implica- 
tions of quotas merit serious consideration and 
monitoring. 
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6 Using Examinations to Improve Education 



In considering the role of examinations 
in educational reform, one should not lose 
sight of tlie range of problems facing educa- 
tion in Africa. The extent of these problems 
varies from country to country, but all coun- 
tries to a greater or lesser extent, face prob- 
lems relating to accommodation, the rel- 
evance of curricula, availability of books and 
materials, and teacher training. Further- 
more, these problems in the educational sys- 
tem co-exist with, and often are caused by, 
economic and social problems in the wider 
society. Problems such as these are not go- 
ing to be solved by improvements in exami- 
nation systems alone. However, examina- 
tions could play a role in the reform of edu- 
cational systems and in improving the qual- 
ity of education in schools. At the very least, 
good assessment procedures must be better 
than bad ones. Furthermore, despite the 
problems that will arise in implementing 
some reforms, such as in measuring and 
teaching higher-order skills and in provid- 
ing feedback information to schools, at- 
tempts to do these things are preferable to 
continuing with examination systems that, 
in many countries are regarded as obviously 
defective in many ways. Besides, there are 
some recommendations that can be made, 
which can hardly be regarded as controver- 
sial, such as the need to include in examina- 
tions assessments of students' ability to write 
if writing is to receive the attention it merits 
in schools. 

We have seen that examinations occupy 
a key role in the educational systems of the 
countries considered in this report. This is 
partly because of a resource problem, in par- 



ticular the inability of educational systems 
to accommodate all students who wish to 
remain at school. In this situation, exami- 
nations are used as the means of allocating 
places to students. Whatever decisions are 
taken about assessment and examinations 
procedures, it has to be recognized that the 
need will remain, for some time at any rate, 
to operate a system of selection that is per- 
ceived to be fair and equitable. And if there 
has to be selection, it nas been argued, for a 
long time in European countries (Curricu- 
lum and Examinations Board - CEB 1985) 
and currently in developing countries 
(Heyneman 1985), that examinations are a 
more equitable way of doing the job than 
other procedures that have been tried. Even 
if examinations continue to be used for se- 
lection, this does not mean, of course, that 
efforts should not be made to improve them 
as instruments of certification also. 

In this chapter, for the fourteen coun- 
tries in our study, we present the proposals 
whivjh were set out in action plans for 
changes in examination systems which, it 
was believed, would lead to an improve- 
ment in the quality of examinations and of 
education. Following that, we provide some 
guidelines which, if followed in the imple- 
mentation of action plans, should result in 
the improvement of examinations. After 
that, we consider problems and undesirable 
effects that can arise from certain kinds of 
examination reform. Finally, we outline 
conditions that should be present in the 
administration of examination authorities if 
these authorities are going to be in a posi- 
tion to support examination reform. 
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Action Plans 

Each of the fourteen countries prepared 
an action plan designed to improve the qual- 
ity and functioning of its examination sys- 
tem. A tabular summary of the plans is 
provided in Table 5.1, separately for Anglo- 
phone, Francophone, and other countries. 
The objectives of the action plans can be cat- 
egorized as relating to Administration, Tech- 
nical and Training Requirements, Equip- 
mcMt, and Construction/Rehabilitation. It 
should be pointed out that the objectives 
were not stated with similar clarity in all 
the reports. 

Administration 

Expand Examination System. The prob- 
lems caused by the substantial increase in 
enrollment figures in general, and in the 
number of candidates taking public exami- 
nations in particular, are reflected in the 
plans to increase the administrative capa- 
bilities of publir, v::amination authorities. 
Five of the six Anglophone countries and 
Ethiopia indicated a need to provide for the 
expansion of their examination systems to 
cope with anticipated inaeases in numbers. 

Localize Examinations. Three countries 
(Lesotho, Mauritius, Swaziland) plan to lo- 
calize public examinations by developing al- 
ternative examinations to those prepared by 
overseas agencies. The challenge for these 
countries is to develop within their exami- 
nation systems the ability to design, print, 
mark, and validate examinations while 
maintaining public confidence by ensuring 
that the new examinations retain the status 
of external examinations such as those pres- 
ently offered by the Cambridge Overseas 
School Certificate Examination Syndicate. 

Phase Out Examinations. In 1987, the 
Kenya National Examination Council dis- 
continued the Kenyan Certificate of Educa- 
tion. Guinea, Cape Verde, and Ethiopia plan 
to reduce the number of public examina- 
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tions which they offer. Ethiopia, for ex- 
ample, has indicated its intention tc elimi- 
nate the Grade 6 National Examination when 
the shortage of junior-secondary school 
places is overcome. 

Centralize Examination Authority. 

Three countries (Cape Verde, Ethiopia, Mau- 
ritania) have indicated a desire to centralize 
responsibility for public examinations within 
one agency. In this way it is hoped to make 
the system more efficient through a sharing 
of scarce resources. In Ethiopia one central 
system is planned as a replacement for the 
Ethiopia School-Leaving Certificate Exami- 
nation Office run by the University of Addis 
Ababa and the National Examination Board 
of the Ministry of Education which has re- 
sponsibility for the Grade 6 ar i Grade 8 
national examinations. 

Centralize Operation of Examinations. 
Assigning printing and packaging of exami- 
nation papers to an external agency increases 
the likelihood of a breach of test security. 
Three large countries (Kenya, Uganda, Zam- 
bia) propose to assign responsibility for all 
aspects of public examinations to one 
agency. At the moment, to cite but one ex- 
ample, the Kenya National Examination 
Council could achieve substantial savings if 
it were in a position to transfer the printing 
of examination papers to an in-house facil- 
ity. 

Create a Technical Bureau/Support Unit. 

The need for the creation of a technical 
bureau or support unit to develop tests, to 
provide training, and to evaluate and carry 
out research on aspects of the examination 
system has been identified in five of the 
Francophone countries (Chad, Guinea, 
Madagascar, Mauritania, Togo.) In Mada- 
gascar, for example, it is hoped that this new 
unit might take responsibility for improv- 
ing school-based assessment techniques, de- 
veloping standardized tests, and carrying 
out specialized studies designed to inform 
those responsible for decision making. 
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Table 5.1 
OBJECTIVES LN DRAFT PLANS 



AdministrAtion Kenya Lesotho Mauritiui> Swaziland Uganda Zambia Chad Guinea 



1 PvnanH Qvci^m fn HpaI 

with increasing numb 
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X 
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X 




X 


*) I ocalizp all Pxams 




X 


X 


X 










3* Phase out exam(s) 


















for exams within one agency 


















5^ Allow agency to assume 
responsibility for all aspects 
of exams (e.g. printing) 




X 














6. Crtjate technical bureau/ 
support unit to develop tests, 
provide training/evaluation 










X 




X 


X 


f * iuipruvc t:rndi;nLy ui cxauis 
by sti*engthening 
management structures 


X 


X 




X 


X 


X 






Technical and Training 

L Improve quality of exams 
(improve exam-syllabus linkage, 
introduce criterion-referenced 
tests) 


X 


X 


X 


X 


X 


X 


X 


X 


2* Improve assessment, research 
and development capacity 
of svstems bv imorovinc: technical 
training/ resources (e.g. library) 


X 


X 


X 


X 


X 


X 


X 


X 


3. Involve teachers more in 
assessment as a replacement for, or 
in conjunction with, public exams 




X 


X 


X 






X 




4. Develop capacity to provide 
feedback information on public- 
exam i>erformance to schools 


X 


X 




X 


X 








5. Provide training for MOE 
officials (school inspectors)/ 
teachers/counsellors in 
assessment and exams 




X 


X 


X 


X 


X 




X 


Equipment 

1. Improve efficiency of exams 
through provision of equipment 


X 


X 


X 


X 




X 


X 


X 


Construction/Rehab 11 itation 

1. Extend /improve accommodation 
for administration of exams 


X 


X 




X 


X 
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Table 5.1 (continued) 
OBJECTIVES IN DRAFT PLANS 



Administration Madagascar Mauritania Rwanda * Togo GipeVerde Ethiopia 



1, Expand system to deal 
with increasing numbers 
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2. Localize all exams 
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for exams within one agency 
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responsibility for all aspects 
of exams (such as . printing) 
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/. improve etnuency or exams oy 
strengthening management structure 


> 
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Techitical and Traixiing 

1. Improve quality of exams 
(improve exam-syllabus linkage, 
introduce criterion-referenced 
tests)** 


X 








X 


X 


2. Improve assessment, research 
and development capacity of 
systems by improving technical 
training/ resources (e.g. library) 


Y 
A 


Y 
A 




Y 
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Y 
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3. Involve teachers more in 
assessment as a replacement for, 
or in conjunction with, public exams 




X 






X 


X 


4. Develop capacity to provide 
feedback iniormaMon on public- 
exam performance to schools 












X 
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officials (school inspectors)/ 
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X 


X 
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X 


Fnuinmpfit' 

1. Improve efficiency of exams 
through provision of equipment 


X 


X 
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X 


X 


Construction/Rehab ilitation 

1. Extend /improve acccnaiH}dation 
for adnrunistration of exams 












X 



a/ Being finalized 

b/ Recommendations to produce tests of "creativity,*' "intelligence," "visualization," are not included here. 
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Improve Management Efficiency. A to- 
tal of ten of the fourteen countries specified 
the need to improve the efficiency of public 
examinations by strengthening management 
structures. In many instances, the lack of 
autonomy of the examination body was dted 
as a factor which restricted the efficiency of 
the examination system. There is also a need 
for a substantial recruitment and training 
program to equip management personnel 
with relevant skills and knowledge. Salary 
scales should be sufficiently attractive to dis- 
courage skilled personnel, such as in the area 
of computing, from seeking employment 
elsewhere. 

Technical and Training Requirements 

Improve Examination Quality. Consid- 
erable agreement is to be found in the ac- 
tion plans regarding the need to improve 
the quality of public examinations. Each of 
thf fourteen countries specified that it 
needed technical assistance in this area. 
Many recognized the need to improve the 
validity of their public examinations, in 
particular to improve the link between the 
content of examination questions and the 
syllabus. Psychometric support was also 
called for to help, among other tasks, to 
develop item banks and construct adequate 
assessment instruments. A number of ex- 
amination bodies recognized the need to in- 
troduce new modes of examining, involv- 
ing oral, aural, and practical tasks. 

Improve Research and Development 
Capacity. The need to introduce or improve 
the capacity of the examination system to 
conduct research directly related to public 
examinations was recognized in each of the 
fourteen countries. In Swaziland for ex- 
ample, it was proposed that this research 
would include validity studies, monitoring 
the implementation of a proposed continu- 
ous-assessment system, and the effects of 
changes in the system on the internal and 
external efficiency of the educational system 
(dropout, repetition, levels of achievement.) 
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In most instances, it is envisaged that for- 
eign training will be required to enable per- 
sonnel to acquire the appropriate research 
skills. In addition to training, research, and 
development, personnel will need to have 
access to libraries equipped with appropri- 
ate technical books, journals, and sample as- 
sessment instruments. 

Involve Teachers in Assessment. 

Slightly over half the countries identified the 
need to inaease teachers' involvement in the 
assessment process. In some instances it is 
envisaged that assessment by teachers would 
eventually replace some external examina- 
tions. Most systems, however, favor the in- 
volvement of teachers in providing part of 
the overall assessment in a particular sub- 
ject examination. For Mauritius for example, 
it is suggested that, following the training 
of teachers in assessment techniques, the 
Certificate of Primary Education would 
show the teacher's grade in addition to the 
external examination grade for each subject. 

Develop Feedback Capacity. Four An- 
glophone countries (Kenya, Lesotho, Swazi- 
land, Uganda) and Ethiopia stressed the 
need to develop the capacity of the public- 
examination system to provide feedback in- 
formation to schools on aspects of students' 
performance on examinations. It is believed 
that such information could contribute to the 
quality of teaching and learning in the 
schools by identifying aspects of the curricu- 
lum that appear to be misimderstood or sim- 
ply ignored by examination candidates. 
Feedback information can also be useful to 
educational authorities by identifying re- 
gional disparities in achievement and aspects 
of the curriculum where candidates fare 
poorly, possibly due to lack of appropriate 
equipment, for example in physics and 
chemistry. 

Provide Training for Inspectors and 
Teachers. Virtually all countries recognize 
the need for the training of Ministry of Edu- 
cation officials, school inspectors, and teach- 
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ers in assessment terminology and proce- 
dures. In-service training seems particularly 
necessary to familiarize teachers with the 
techniques required to conduct school-based 
assessment. Zambia's proposal envisages 
that as many as 10,000 secondary-school 
teachers would attend a ten-day in-service 
training course over a four-year period. Cape 
Verde authorities propose that a foreign ex- 
pert sliould train a cadre of people who in 
turn would become trainers of others. 

Equipment 

All action plans indicate a need for equip- 
ment. Specified needs relate mostly to the 
production of examination papers, such as 
printing equipment, and the processing of 
examinations. Data-processing equipment is 
required for scoring multiple-choice exami- 
nations, the preparation of results, and for 
storing of assessment information. Main- 
frame and micro-computers have been re- 
quested. Books and journals on testing and 
measurement have also been listed. Other 
equipment that is frequently requested in- 
cludes typewriters, photocopiers, and paper. 
A number of countries have asked for fur- 
niture, (Madagascar and Togo), and motor 
vehicles, (Lesotho and Mauritania). 

Construction/ Rehabilitation 

Fo\ir Anglophone countries, three Fran- 
cophone countries, Cape Verde, and Ethio- 
pia include specific requests for construction 
and /or rehabilitation of buildings. Kenya 
and Uganda require the construction of large 
buildings to house printing equipment. The 
Ugandan proposal outlines the need for a 
building to house, in addition to printing 
equipment, a computer facility as well as 
rooms for desktop publishing. Other coun- 
tries, for example Togo and Chad, require 
the construction of buildings to accommo- 
date all examination board personnel. Le- 



sotho and Madagascar have indicated that 
their examination offices are badly in need 
of repair and improvement. 

Cross-National Cooperation 

A nimiber of countries referred to the 
benefits of cross-national cooperation in ex- 
aminations but did not actually include pro- 
posals for such cooperation in their action 
plan. Two possible approaches to cross-na- 
tional cooperation are outlined here. 

First, associations of examining bodies 
might be formed to enable those involved in 
examinations to exchange information and 
experiences and to provide short-term train- 
ing courses. Such an association (The Asso- 
ciation of Heads of Institutions Responsible 
for Examinations and Educational Assess- 
ment in East and Southern Africa) already 
exists in the Anglophone areas of eastern and 
southern Africa. This association, however, 
is in need of financial support. There is also 
a need to cater for countries in non-Anglo- 
phone areas. 

The second proposal for improving cross- 
national cooperation relates to tl e establish- 
ment in a university of research facilities and 
post-graduate courses relating to measure- 
ment, assessment, research, and evaluation. 
It would probably be necessary to make this 
provision in both Anglophone and Franco- 
phone areas. 

Before this step is taken, there will be a 
need, as indicated in individual country ac- 
tion plans, to have individuals go to univer- 
sities in Europe or North America for post- 
graduate studies. Consideration should be 
given to having individuals from several 
countries attend the same institution as this 
could help establish relationships which 
would form a useful basis for future co-op- 
eration when the individuals return to their 
own countries. 
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Improving Assessment in Public 
Examinations 

A number of guidelines sliould be fol- 
lowed to improve assessment in the public- 
examination system. Before presenting them 
two general points about examination reform 
that have already been made might be re- 
peated. First, such reform has to be consid- 
ered In the general context of the educational 
system, not as an isolated element in it. 
Changes in the assessment system are likely 
to depend on, and to affect other aspects of 
the educational system. The dependence of 
examination reform on other aspects of an 
educational system is perhaps most obvious 
when one considers the resources that will 
be required to implement reform. On the 
other hand, the effects of reform are likely to 
exhibit themselves in the quality of students 
that are selected for further education, as well 
as in the character of curricula offered in 
schools. Second, in considering examination 
reform, one has to be conscious of the fact 
that there is no perfect system of assessment 
and that there is no point in looking for one. 
Any system will have advantages and dis- 
advantages. This will be particularly obvi- 
ous when an assessment system is used to 
serve more than one purpose. It is the task 
of individual countries, in the light of their 
traditions, resources, values, and needs to 
decide what balance of options best suits 
them. Since it is not usually possible to an- 
ticipate precisely the advantages and disad- 
vantages of any system in advance, it is im- 
portant that the effects of examination re- 
form, particularly on curricula and teaching 
practice, should be monitored. With these 
points in mind, we may now turn to more 
specific guidelines for the improvement of 
assessment in the context of public examina- 
tions. 

First, assessment should be based on the 
official curriculum. However, since not 
everything included in a curriculum can be 
assessed, the areas which are selected will 
be regarded by teachers and students as very 



important and will receive special attention. 
Hence, the areas selected for inclusion in 
examinations should cover important 
curricular topics. 

Second, insofar as it is possible, the 
modes of assessment (written, practical, and 
oral) which are used should be diverse and 
should reflect the goals of curricula. What 
is tested is what is likely to be taught and 
what is not tested is likely to be ignored. 
Hence, if examinations do not require stu- 
dents to write continuous prose, the skills 
involved in this activity will probably not 
receive much attention in schools. Similarly, 
examinations that do not include oral or 
practical components are likely to lead to a 
neglect of skills in these areas. However, cost 
is a serious problem if external examiners 
are used, particularly in the case of oral and 
practical skills. For this reason, the possibil- 
ity of using assessments by teachers within 
the school is worth exploring. If done prop- 
erly, such assessments are likely to be less 
expensive than external ones and are also 
likely to be more valid. However, some sys- 
tem of moderation may be required if 
teacher assessments are incorporated into the 
public-examination system. In this case, it 
should he borne in mind that moderation 
can be cumbersome and expensive and, in 
some circumstancevS, quite impractical. 

Third, assessment instruments should 
pay adequate attention to the measuren^ent 
of higher-order thinking skills. Many tests, 
and these are the easier ones to construct, 
require little more than the recall or recog- 
nition of information. However, if it is 
agreed that "there is a need to make deep 
learning a central goal of education, and to 
foster development of this goal throu^,h the 
evaluation of students," then it will be nec- 
essary to "...place emphasis on underslaiid- 
ing, transfer of learning to untaught j^rob- 
lems or situations, and other thinking skills, 
evaluating the development of these '.kills 
through tasks that clearly must involve more 
than recognition or recall" (Crooks 1988). It 
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is assumed in this view that the inclusion 
of tasks requiring higher-order skills in tests 
will lead to greater emphasis on teaching 
these skills in classrooms. There is in fact 
some evidence from a study carried out by 
Ogundare (1988) in Nigeria, in which pri- 
mary-school students were taught social 
studies using a problem-approach method. 
This suggests that when this emphasis is 
present, not only do students acquire more 
facts, they also comprehend material better 
and are better able to apply their knowl- 
edge to the solution of new problems and 
to evaluation activities. 

Various taxonomies have been designed 
to help test constructors elicit higher-order 
thinking skills in students. Some of these 
contain as many as six levels (such as Bioom 
1956, Perrott 1982). However the construc- 
tion of a test which distinguishes clearly be- 
tween that many levels might not be pos- 
sible. Problems arise particularly at higher 
levels designed to measure synthesis and 
evaluation. For example, in Britain, the 
specification of achievement levels within 
subject areas where higher-order or general 
skills were involved has proved very diffi- 
cult in the context of developing a system 
of assessment for the new national curricu- 
lum (Nuttall 1990). Because of this, it is 
perhaps better in test construction to think 
in terms of a simpler taxonomy containing 
two levels rather than six. The first level 
could cover what might be called "minimal" 
objectives, which most students might be 
expected to achieve, and would relate to 
the acquisition of knowledge and basic skills 
(recall and comprehension in Bloom's tax- 
onomy). The second level would involve 
higher-oraer outcomes, defined in terms of 
more complex cognitive processes. While 
tests of minimal objectives would examine 
students' ability to deal with familiar con- 
cepts and rehearsed skills, the higher-order 
ones would examine students' ability to 



apply learning to new material or situations 
(Gronlund 1973; Terwilliger 1989). 

Even with a simplified taxonomy, it is 
impossible to be sure that the taxonomic 
level of an item will evoke the targeted tax- 
onomic level in the candidate answering the 
item. Whether or not it does will depend 
on the learning experiences of the candidate 
(Torrance 1986). Bloom (1956) was aware 
of this when he observed that if a problem 
designed to measure application is too sim- 
ilar to problems used in class, it will mea- 
sure comprehension rather than application. 

A fourth guideline to be followed in the 
construction of examinations is that exami- 
nations should test students' ability to ap- 
ply their knowledge and skills not just in 
scholastic contexts but in situations outside 
the school as well. Thus the examinations 
should take into account the everyday life 
conditions of students and the kinds of prob- 
lem they are going to meet at home, on the 
farm, in the shop, or in the market place. 

The Kenya Primary School Certificate Ex- 
amination provides examples of items which 
relate to situations outside the school. The 
following are examples of such items: 

Diarrhoea is a disease that kills many 
babies in Kenya. When babies have 
diarrhoea they lose a lot of water and 
foods. One correct way to treat ba- 
bies with diarrhoea is to: 

A. keep them wrapped up and warm 
so that they sweat out the sick 
ness 

B. give them drinks of boiled cold 
water containing some sugar and 
a little salt 

C .give them solid foods contain 

ing plenty of carbohydrates 
D.give them very little food or 

water until the diarrhoea stops. 
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Wangari lives in a village with many 
people. From which one of the fol- 
lowing sources can Wangari collect 
the best drinking water? 

A. a big river nearby 

B. the rain from her mabati roof 

C. the dam near the village 

D. a swamp on her farm. 

A fifth guideline recognizes that exami- 
nation scores used for selection should dif- 
ferentiate between candidates on the basis 
of characteristics relevant to the opportuni- 
ties being offered. Thus, there is a need to 
carry out studies of the predictive validity 
of selection instruments. 

The fact that examination scores are im- 
perfect measures of students' achievements 
is the basis of a sixth guideline. It is desir- 
able that the past performance and relevant 
experience of students be taken into account 
in making important decisions about stu- 
dents. This guideline points to the need to 
develop the capacity of teachers and schools 
to carry out school-based assessment that 
will be acceptable outside the classroom. 

A seventh guideline takes up the recom- 
mendation of several commentators that de- 
tailed feedback information on the perfor- 
mance of students in examinations should 
be provided to schools and teachers. For ex- 
ample, Lewin (1984) has pointed out that 
telling a teacher that 20 percent of a class 
has failed does not communicate the causes 
of either the teacher's or the students' fail- 
ure. However, if teachers were told which 
questions and tasks students had completed 
satisfactorily and which ones they had not, 
the information could be used as a basis for 
remedial action. The information would be 
even more useful if accompanied by an in- 
terpretation of student difficulties as well as 



by guidance on the design and implementa- 
tion of possible remedial actions. 

The most serious efforts to provide feed- 
back information to schools have been made 
by the Kenya National Examinations Coun- 
cil. While the Newsletter of the Council is 
commended by Lewin (1984) as providing 
"excellent examples" of the kind of feedback 
that is likely to be helpful to teachers, it does 
not in fact provide teachers v,nith the kind of 
information recommended by Lewin. Since 
the information in the Newsletter is limited 
to national statistics about performance, 
there is no way a teacher can ascertain how 
his or her class performed on particular 
aspects of the examination. Thus, the basis 
for remedial action is limited. While the 
provision of information on examination 
performance on a school-by-school basis 
would be necessary to meet Lewin's condi- 
tions, the logistical problems to which this 
would give rise are formidable. 

The provision of detailed information on 
the performance of students in the hope that 
teachers will direct their efforts towards the 
topics and skills covered in examinations and 
thereby raise students' test performance 
raises a broader issue which merits attention. 
It is not surprising that research evidence in- 
dicates that the test performance of students 
will improve if they have been taught the 
specific material covered by a test and if they 
have been freqr«ntly exposed to the test for- 
mat (Cooley and Leinhardt 1980; Le Mahieu 
1984). However, are we justified in conclud- 
ing on the basis of improved student test per- 
formance that students' actual achievement 
(in terms, for example, of problem-solving 
skills), as di'^tinct from their test performance, 
has also improved? The answer would seem 
to be no, at least until we have satisfied our- 
selves that some of the variance in test scores 
is not attributable to the form of the test used 
(method of measurement) rather than to the 
individual characteristics (achievement) that 
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the test is designed to measure (see Polger 
ana Kellaghan 1990; Campbell and Fiske 
1959). Students are taught in such a way 
that the match between instructional pro- 
cesses and test items is very close, then in- 
ferences about students' actual skills and 
knowledge become very difficult to make. 
The problem is particularly acute if we want 
to test whether a student can apply skills and 
knowledge to solve new problems, since in 
this case, the problems must be new to the 
student and not ones that were taught in 
class. Practice on a problem may improve 
students' test scores; however, not only will 
it eliminate the possibility of drawing un- 
ambiguous conclusions about students' abil- 
ity to solve problems, it may actually have 
the effect of interfering with the development 
of understanding by students (Linn 1983a, 
b). 

This situation creates a dilemma for 
which there is no obvious solution. To what 
extent should one improve the match be- 
tween testing and instruction, not only to 
promote appropriate curriculum coverage 
but also to ensure that what is tested is what 
is taught, if, at the same time, the al ity to 
measure application and problem-solving 
skills is going to be compromised? On the 
oth'ir hand, should one include new prob- 
lems and types of problems on examinations 
w" . the objective of assessing higher-order 
skills, knowing that this will create the risk 
of failing to measure what is taught? (Linn 
1983b). 

An eighth guideline relates to the assess- 
ment of the impact of examination reform 
on student achievement. On the basis of the 
previous discussion, which implies a distinc- 
tion between test performance and achieve- 
ment, it should be clear that the use of test 
instruments, v/hich are part of an instruc- 
tional treatment, to monitor the effects of that 
treatn\ent, a.«? in Somerset's (1987) Kenyan 
study, cannot be regarded as satisfactory. 
The problem in this approach concerns con- 



struct validity (LeMahieu 1984). If students' 
examination scores are used to assess the ef- 
fect of providing information to schools 
about students' test performance, the sort of 
learning tliat is revealed in the examination 
score may be made up largely of skills that 
are more properly considered test- taking 
skills than achievement as indicated by stu- 
dents' ability to use higher-order skills. In- 
deed, as noted above, the more effective the 
treatment is in terms of having teachers teach 
to the examination, the greater will be the 
match between instructional processes and 
test items, and, as a consequence, the more 
limited will be our ability to draw inferences 
about students' actual skills and knowledge 
as distinct from test-performance skills, This 
guideline then specifies the need to use al- 
ternative methods of measuring achievement 
when assessing the effects of an examination 
reform which involves providing detailed in- 
formation on students' performance to 
schools. 

The final guideline, concerns the need to 
develop effective assessment strategies, dis- 
tinct from public examinations, to assess the 
performance of the educational system and 
of individual institutions. One type of strat- 
egy will probably not meet the requirements 
of these two purposes. A procedure involv- 
ing testing in a sample of schools may be 
adequate for the assessment of the perfor- 
mance of the educational system, while a 
more school-specific approach, which might, 
for example, be incorporated into the func- 
tions of the school inspectorate, will be re- 
quired in the assessment of individual 
schools. 

Anticipating Problems and 
Undesirable Effects 

In considering proposals to improve as- 
sessment procedures and, in particular, to 
design examinations which will have a ben- 
eficial effect on curricula and student 
achievement, it is important not to 
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underestimate the problems involved in the 
task (see Airasian 1988). It is also important 
to guard against possible unintended conse- 
quences that may arise. 

The first problem relates to the task of 
specifying desired outcomes of instruction 
on which curricul* and examinations might 
be based. The task involves important value 
judgments; hence it may not be easy to reach 
agreement on what the outcomes of school- 
ing should be. Besides, such outcomes 
vary, even within a single country, accord- 
ing to the different circumstances in which 
schools operate and in which their students 
live. 

Of interest in this context are proposals 
to make education more relevant to the 
needs of rural children (the majority of chil- 
dren in Africa). Such proposals have been 
made repeatedly in the history of African 
education (se^ ior example, Gifford and 
Weiskel 1971: Jones 1922, 1924). On tiie 
whole, they failed to gain acceptance, prob- 
ably largely because of parents' antipathy 
to them. Since parents saw traditional aca- 
demic education as the route to occupations 
with the greatest prestige and reward, a 
failure to provide children with such educa- 
tion was seen as limiting their occupational 
opportunities (see Blaug 1973; Bray, Clarke, 
and Stephens 1986; Foster 1965; Keilaghan 
1991). It remains to be seen whether the 
current emphasis being placed on local rel- 
evance will be more acceptable than past 
efforts (see Lockheed and Verspoor 1990). 
It may be, as the number ?f children attend- 
ing school increases, that the prospects of 
the more desirable occupations to which 
parents aspired for their children in the past 
will be seen to be less realistic. Much too 
may depend on the degree of localization 
that is introduced into curricula. If curricula 
for children in rural areas are limited to 
teaching basic principles relating to health 
and agriculture and do not deviate from the 
traditional curriculum to the extent that rural 
children would be at a disadvantage in scho- 



lastic competition, they may be more accept- 
able now than they were in the past. Fur- 
ther, the idea of relevance in curricula can 
be defended without reference to the future 
lives of d^ildren. Tasks that are related to a 
child's previous experience and are seen to 
have relevance to everyday life are more 
likely to motivate children to learn than are 
more abstract tasks. 

A second problem in the design of ex- 
aminations relates to the complexities in- 
volved in teaching stated objectives. The 
mere positing of goals, or even their incor- 
poration into examinations, does not guar- 
antee their achievement. Indeed, as we have 
seen above, it may inhibit them. The prob- 
lem is likely to be most acute if the exami- 
nations, as test designers are increasingly 
striving to do, place emphasis on measur- 
ing higher-order behaviors rather than, or 
in addition to, general minimum lower-level 
behaviors. The earlier discussion alluded to 
the problem of measuring higher-order be- 
haviors. Evidence is also available to indi- 
cate that teaching such behaviors is differ- 
ent in many ways from teaching lower-level 
rote behaviors. For example, higher-level 
behaviors take longer to teach, develop 
gradually over time, are less amenable to 
direct instructional approaches, are often dif- 
ficult to locate in a curriculum, and may be 
too diffuse to drive instruction (Airasian 
1988). 

Faced with such difficulties, teachers may 
resort to teaching students test-taking strat- 
egies which may undermine the objectives 
of the examination (Madaus 1988; Madaus 
and Keilaghan, forthcoming). Over time, 
teachers become familiar with the formal re- 
quirements of the examination and prepare 
students to deal with these rather than with 
curricular objectives. Strong evidence of this 
has been observed in a number of African 
countries, and the evidence is not confined 
to Africa. Selection-type questions, when 
used in examinations, become a particular 
focus of attention. Not only are students 
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taught how to cope with such questions, but 
normal teaching may be presented in the 
form of statements accompanied by a range 
of options from v/hich students are required 
to choose, (for example, The capital of France 
is: Brussels, Paris, Lyon, Toulouse). This 
form of teaching may be used, not just in 
the examination class, but can filter right 
down the school, as has been observed in 
reception classes in African schools. 

A further possible undesirable effect of 
public examinations, particularly if the re- 
sults of schools are publicized, is that schools 
may require pupils to repeat grades, either 
to take more time to prepare for the exami- 
nation or to avoid taking it at all (Madaus 
and Greaney 1985). In the case of Kenya, 
Oloo (1990) states, though he does not pro- 
vide supporting data, that "it is fairly obvi- 
ous that the schools which perform best in 
KCPE are those which enter a few selected 
candidates." Further, pupils, as a result of 
academic pressures, may leave school at an 
early stage. Grade repetition and drop-out 
are, in the United States at any rate, inter- 
related (Catterall 1989) and are probably the 
result of a variety of factors, which include 
family and student characteristics, low per- 
ceived benefits from education, and school 
ineffectiveness (Lockheed and Verspoor 
1990; Swaziland, Ministry of Education 
1986). Care should be taken to ensure that 
the pressures to perform well on public ex- 
aminations do not lead to an exacerbation 
of problems of repetition and inefficiency in 
schools. 

Finally, as has already pointed out in 
Chapter 4, the ranking of schools in terms 
of examination success, especially when no 
account is taken of the entry characteristics 
of pupils, their home circumstances, or the 
characteristics of schools, can be unfair and 
can have disastrous effects on the morale of 
schools. 



Conditions to Improve the Administration 
of Examinations 

In this section, some conditions relating 
to the administration of examinations anJ 
examination authorities are outlined. These 
are necessary if the efforts to develop public 
examinations which will have a positive 
effect on school curricula and student 
achievement are to be effective. 

Examination Authority 

In the first place, the body entrusted with 
the construction and administration of the 
examinations must be adequately financed 
and staffed. The body should have sufficient 
resources and competencies to develop ex- 
amination instruments, to analyze examina- 
tion performance, and to carry out research 
on examinations. Resources should include 
access to foreign exchange to allow for pur- 
chase, maintenance and repair of equipment. 
At present, most examination bodies in Af- 
rica have insufficient resources and are hard 
pressed just to administer the system, leav- 
ing no time for reflection or research. 

Salary levels should be sufficiently attrac- 
tive to ensure that skilled personnel are not 
forced to seek employment elsewhere. Fre- 
quently in the past, personnel with high- 
level skills have been attracted to other jobs, 
particularly in private industry, where sala- 
ries are higher. 

In some countries, making examinations 
largely self-financing through examination 
fees has helped provide financial resources 
to enable the authority to operate '•'•'ith some 
degree of independence. 

Whatever the location of an examinations 
body, it is crucial that it should be indepen- 
dent in the exercise of its functions. In some 
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countries the examination body is located 
in a Ministry of Education; in other coun- 
tries, it is a separate body, though working 
in dose co-operation with the Ministry of 
Education. Elsewhere, the examination body 
is closely associated with a university; within 
some countries, in fact, universities and other 
authorities administer different public ex- 
aminations. There are factors in favor and 
against each arrangement. The decision that 
is made in any individual country about the 
location and control of the examination body 
will probably be largely determined by the 
country's tradition and experience. 

National Cooperation 

Examinations represent one part of the 
educational process. Structures should be de- 
veloped to allow the examinations author- 
ity to work in close liaison with bodies re- 
sponsible for educational administration and 
curricula. Cooperation can help ensure that 
the public examinations serve the needs of 
all students in the system, improving the 
general quality of education and satisfacto- 
rily serving the functions of certification and 
selection. It can also help to ensure that 
examinations adequately reflect curricula 
and not only that, but that they are seen to 
do so. Public examinations that reflect na- 
tional curricular priorities can serve as a 
powerful positive change agent in the edu- 
cational system. 

The examinations body should also 
work closely with teachers. Most examina- 
tion bodies make use of teachers to mark 
examination scripts. This can be a good way 
of letting teachers know what is important 
in examinations. Obviously, it is important 
to have as many teachers as possible in- 
volved in this exercise so that first-hand in- 
formation about examinations is generally 
available in the educational system. 



Teachers can also be involved in con- 
structing examination questions. For ex- 
ample, teachers might contribute items to a 
national item bank, from which examina- 
tion questions might be selected. Apart from 
involving teachers directly in the examina- 
tion process, this practice might also serve 
to integrate public examinations with the 
internal assessn\ent procedures of schools. 
Teachers would come to know what things 
are assessed in public examinations and 
would follow similar practices in their own 
in-school assessments. At the same time, 
teachers would have an input into the ex- 
amination system ensuring that what is 
asked in the public examinations is relevant 
and appropriate to their students. 

Communication between examination 
boards and teachers could also be improved 
considerably through the introduction of 
newsletters which would include detailed 
results of pupil performance and how to deal 
with problems. 

Other forms of communication from ex- 
annination boards include providing infor- 
mation about standards through the school 
inspectorate and selected teachers, the pro- 
vision of in-service courses, and responding 
to individual queries from teachers and other 
agencies. Pre-service teacher training should 
include courses on assessment. Participants 
in these courses r>hould be introduced in a 
practical way to a variety of assessment pro- 
cedures. 

International Cooperation 

In considering the reform of axamina- 
tions, the need for cooperation and sharing 
of scarce resources should be recognized. Ex- 
changes of item writers, markers, and other 
technical personnel, as ^s commonly carried 
out in a small number of countries, should 
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be fostered. Security tnreats and procedures 
should be reviewed. While countries are not 
likeiy to administer common public exami- 
nations, international cooperative studies 
might be conducted on common curricular 
areas. Perhaps the main advantage of such 
comparative studies is the focus it could 
bring to bear on existing curricular goals and 
objectives in individual countries. Regional 
organizations such as the recently founded 
Association of Heads of Institutions Respon- 
sible for Examinations and Educational As- 
sessment in East and Southern Africa should 
be encouraged and supported. Such orga- 
nizations can provide a structure within 
which regional and international coopera- 
tion can be promoted. 

Number and Format of Public Examinations 

Consideration should be given to reduc- 
ing the number of public examinations ad- 
ministered. Economies incurred should be 
devoted to improving the quality of the pri- 
mary leaving and the senior-cycle second- 



ary leaving-certificate examinations. Im- 
proving the quality of public examinations 
will of necessity require examination au- 
thorities to change existing modes of assess- 
ment. In particular, examination officials 
should be requested to improve the mea- 
surement of higher-order cognitive skills, 
and skills related to everyday life, and to 
develop techniques of oral, aural, and prac- 
tical assessment. 

Formal Training 

Well developed, advanced-degree 
courses in measurement and assessment 
should be offered by at least one university 
in an Anglophone area and one in a Franco- 
phone area. In addition to recruiting stu- 
dents in the normal manner, special leave 
arrangements should be made to allow 
members of national examination authori- 
ties to enrol. Courses offered should cover 
item construction, psychometric theory, re- 
search design and methodology, curriculum 
theory and design, computer applications, 
and management. 
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7 Conclusion 



In considering the reform of public ex- 
aminations, it has to be recognized that some 
of the problems associated with examina- 
tions are not due to the format or adminis- 
tration cf the examinations per se, but fo 
structural aspects of the educational systems. 
For example, the severe shortage of suffi- 
cient secondary-school places would, irre- 
spective of the quality of the examination 
used for selection purposes, inevitably have 
a strong limiting influence on teaching sfyle 
and the nature of student learning towards 
the end of primary school. Thus, in the final 
analysis, it needs to be stressed that the role 
of public examinations in contributing to im- 
provements in achievement levels will be 
tempered by a range of factors over which 
examination authorities have littie or no con- 
trol. Unless governments and ministries of 
education tackle the problems created by a 
lack of places in schools, poor quality of in- 
struction, inadequate supplies of books and 
equipment, and the inability of students to 
understand the language of instruction, re- 
forms in public examinations, no matter how 
far-reaching, are unlikely to be very effec- 
tive. 

While factors other than examinations af- 
fect school quality, they also place con- 
straints on the kind and extent of examina- 
tion reform that is possible. Thus, those con- 
cerned with proposing changes in examina- 
tions have to take into account the context 
in which the changes will be implemented. 
In particular, the conditions which operate 
in schools, which vary considerably across 
the countries considered in this report, and 
which include school facilities, the quality 
and availability of text books, number of 
unqualified teachers, class size, and provi- 



sion for school supervision, will limit the 
options that are available to the examina- 
tion reformer. 

Having said that, it should be also rec- 
ognize that unreformed examination systems 
are likely to cause damage to the quality of 
education offered in schools. It obviously 
makes sense to take steps to change such 
systems and to develop examinations which 
are more in keeping with principles of good 
assessment practice. Well designed and re- 
sponsibly used assessment can be an im.por- 
tant source of information about what and 
how well students are learning and which 
ones are most likely to make the most of 
opportunities that cannot be provided for 
all (see NCTPP 1990.) 

Most countries, to varying degrees, have 
in recent years actually implemented 
changes in their examination systems. These 
changes relate to the techniques of assess- 
ment, to a broadening of the scope of as- 
sessment and, in turn and related to this, a 
shift in responsibility for assessment. 

In Anglophone countries, the main 
change in techniques relates to the introduc- 
tion of multiple-choice tests to replace free- 
response ones. 

But there have been other changes. In 
some countries, the scope of the examina- 
tions has been broadened considerably by 
combining school-based assessments with 
the results, of a terminal examination. This 
has increased the involvement of teachers 
in the assessment process, though these 
kinds of assessment are accompanied by 
strict monitoring procedures. 
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At one level, changes represent an at- 
tempt to improve efficiency by applying new 
technology. For example, the use of ma- 
chine-scored multiple-choice items rather 
than person-scored essays helps to reduce 
scoring costs, as non-multiple choice exami- 
nations are between two and five times more 
expensive to design and grade than mul- 
tiple-choice examinations (Heyneman 1986.) 
The changes may, however, represent more 
fundamental shifts in the control and role of 
examinations. The use of coursework as- 
sessment, for example, involves a shift in 
the control of examinations and of the selec- 
tion process, which is based on it. Some of 
the other changes may herald a shift in em- 
phasis in the role of examinations from one 
of selection to one of certification, as v/ell as 
an attempt to replace assessment-led cur- 
ricula by curricula-led assessment. Attempts 
to provide a more adequate sampling of cur- 
ricula in examinations suggest, in addition 
to a concern for curricular validity, a con- 
cern with the performance of all children 
rather than just the ones that are likely to be 
selected to remain in the educational sys- 
tem and an effort to restructure testing so 
that talent is promoted rather than merely 
screened or classified. 

These comments suggest that important 
values may underlie changes in examina- 
tions. Consideration should be given to 
these values and how they fit with a 
country's aims and priorities for its educa- 
tional system. Insofar as any country can 
achieve consensus in its aims for education, 
it would seem important that, in consider- 
ing examination reform, an attempt should 
be made to reach some level of agreement 
and establish some set of priorities in val- 
ues pertaining to education. For example, 
is the function of the educational system pri- 
marily to select a small cohort of students 
for higher levels of education or is it to pro- 
vide basic skills for the total population? Or 



is it to do both, and if it is, what kind of 
balance should be struck between the dif- 
ferent functions? The rhetoric in most coun- 
tries would suggest that the provision of 
basic skills for the total population is more 
important; present examination practice 
would often seem to suggest that selection 
is more important. 

These considerations should not be taken 
to imply that an ideal assessment system 
will neatly fall into place once resources 
have been assessed and the values and aims 
of an educational system have been agreed, 
insofar as these can be agreed. As has been 
noted, no examination system is without its 
defects. The design of a system will inevi- 
tably involve a series of trade-offs so that 
final decisions will represent a set of provi- 
sional compromises among competing val 
ues (EcV ,-iin and Noah 1988; Noah and 
Eckstein 1990.) Old and new values will 
most likely continue to compete. For ex- 
ample, even if greater emphasis is placed in 
policy on the education of all children, it is 
unlikely that the use of examinations for 
purposes of selection, even at a relatively 
early stage in the educational careers of 
children, can be abandoned. 

Compromise too will be forced on coun- 
tries by lack of resources. 'Hius, the guide- 
lines set out in this report to improve as- 
sessment in public examinations are meant 
to be just that — directions in which to travel 
rather than objectives to be achieved in the 
immediate future. It is our belief, that if re- 
forms are instituted which are pointed in 
the directions indicated in the guidelines, if 
the necessary administrative steps, set out 
also in the report, are taken, and if prob- 
lems and undesirable effects are anticipated 
and steps taken to deal with them, then the 
quality of examinations and of educational 
systems in general will improve in Africa. 
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P=Primary; Sl=Secondary Junior Cycle; S2=Secondary Senior Cycle 
Sources: UNESCO (1988), and national reports 
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Appendix 2 

TITL ES AND DESCRIPTIONS OF EXAMINATIONS 

Countries/ 

Linguistic 

Status 

When Given Title Function Type Responsibility of 

Anglophone 
KENYA 



ERIC 



1. End of primary 
(8)' 



2. End of secondary 
(4) 
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3. End of primary 
school (7) 



4. End of junior 
cy( 
(3) 



cycle secondary 
(3) 



5. End of senior 
cycle (2) 

MAURITIUS 

6. End of primary 
(6) 



7. End of first 
cycle secondary 
age 16+ (2) 



8. End of second 
cycle secondary 
age 18+ (2) 



KCPE" 



KCSE 
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Certification/ 
Selection 



Primary School 
Leaving Certificate 
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Junior Certificate 
Examination 



Certification/ 
Selection 



Certification/ 
Selection 



Cambridge Overseas Certification/ 
Certificate Exam. Selection 



CPE 

Primary Educ. 
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Selection 
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Essay, KNEC 
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Practical, 
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Almost all 
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Letter and Essay 



Ministry of 
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Short answer Council of 



Practical 
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Essay 

Multiple 
choice 
Essay, 
Practical 
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Essay, 
Practical 



Lesotho 
UCLES 



MES 



MES 

and UCLES 



MES in 
collaboration 
with UCLES and 
University of 
LondoiT GCE O- 
and A- Levels 



a. Numbers in parentheses indicate the number of grades at a particular level 

b. Acronyms defined on page ix. 
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When Given 



Title 



Function 



Type 



sponsibilit)' of 



SWAZILAND 

9. End of Primary 
(7) 



Primciry Certificate Certification/ 

Selection 



10. End of first Junior Certificate Certification/ 

cycle secondary Selection 
(Form 3) 



11. End of second Cambridge Overseas Certification/ 
cycle secondary Certificate Selection 
(Form 5) 



Multiple- 
choice plus 
Essay, 
Practical, 
Listening 
Comprehension 

Multiple- 
choice plus 
Essay, 
Practical, 
Listening 
Comprenension 

Short 

answer 

Essay 



Swaziland 

Examination 

Council 



Swaziland 

Examination 

Council 



Swaziland Exam. 
Council and UCLES 



UGANDA 

12. End of primary PLE 
(7) 

13. End of first UCE 
cycle secondary 

(4) 



14. End of senior UACE 
cycle secondary 
(2) 



Certification/ 
Selection 

Certification/ 
Selection 



Certification/ 
Selection 



Short 
answer 

Short 
answer 
Practical, 
Projects 
Oral, Aural 

Short 
answer 
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Projects 
Oral, Aural 



UNEB 
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UNEB 



ZAMBIA 

15. End of primary 
(7) 



16. End of junior 
cycle secondary 
(2) 



17. End of senior 
cjcle secondary 



Grade 7 Composite Certification/ 
Examination Selection 



Grade 9 

Junior Secondary 
School Leaving 
Examination 



Joint School 
Certificate and 
General Certificate 
of Education Exam 
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Certification/ 
Selection 



Multiple- 
choice 
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Multiple- 
choice, oral 
and aural 
, practical 



Examinations 
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Zambia 

Exanunations 
Coimdl of 
Zambia 



Essay, Multiple Exan:iinations 
choice. Council of 

Practical Zambia 
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Appendix 2 (continued) 



When given 



Title 



Function 



Responsibility of 



Francophone 
CHAD 

18. End of primary 
(6) 



19. End of primary 
(6) 

20. End of first 
cycle secondary 
(4) 

21. End of first 
cycle secondary 
(4) 

22. End of second 
cycle secondary 
(3) 

GUINEA 

23. End of primary 
(6) 



24. End of first 
cycle secondary 
(4) 

25. End of second 
cycle secondary 
(3) 

MADAGASCAR 

26. End of primary 
(5) 



27. Annual first 
cycle secondary 
(4) 

28. End of first 
cycle secondary 
(4) 



CEPE 
CEPEA 



Primary 
Concours 

BEPC 



Concours for 
second cycle 

Baccalaureat 



Seventh year 



BEPC 



Baccalaurht 



Certification Written 



Selection 
Certification NA 



Selection 



Selection / 
Certification 



NA 



Dictation, 
arithmetic 



Essay and 
Oral 



NA 



Entrance/ NA 
Selection 



CFEPCES 



NA 



Certifiction/ Written, 
Selection Oral 



CEPE Certification/ Written 

(Regional E.. am) Selection 



School-based Selection/ Written, 

Promotion Oral 



Certification/ NA 
Selection 



SEC 

Ministry of 
Education 

SEC, Ministry of 
Education 

SEC, Ministry of 
Education 



SEC, Ministry of 
Education 



National 
University of 
Chad 



National 

Education 

Ministry 

National 

Education 

Ministry 

National 

Education 

Ministry 



Ministry of 
Primary Ed. and 
Provincial 
Director 

School 



Ministry of 
Primary and 
Secondary 
Education 
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When given 



Title 



Function Type Responsibility of 



29. End of second 
c^de secondary 

30. After two years 
of post-primary 



31. After two years 
of senior cycle 
education 

32. End of second 
cycle secondary 
(3) 

MAURITANIA 

33. End of primary 
(6) 

34. End of primary 
(6) 

35. End of first 
cycle secondary 
(3) 

36. End of second 
cycle (3) 
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37. End of primary 
school 
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technique 
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Secondary 
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Primary Education 

Ministry of 
Secondary and 
Primary Education 



Ministry of 
Education 

Ministry of 
Education 

Ministry of 
Education 



Ministry of 
Education 



Ministry of 
Primary and 
Secondary 
Education 



38. Term and end Oi 
year 



39. Third, fourth 
and fifth years 
of secondary 



School-based 



Examens de 
reclassement 



Feedback/ 
Promotion 



Placement of 
students from 
private or 
foreign schools 



Written, 

Oral, 

Practical 

NA 



Teacher 



Committee for 
Programs in 
Secondary Schools 
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Appendix 2 (continued) 



When given 



Title 



Function 



Type 



40. NA 



Le Jury Central 



Certification/ 
Selection for 
private and 
repeat 
candidates 



Oral 



Responsibility of 



Conunittee for 
Programs in 
Secondary Schools 



41. End of secondary NA 
(6) 



TOGO 



42. End of 6th grade CEPD 



Certification 



Certification/ 
Selection 



Written 
(Essay, 
Multiple- 
choice, Oral) 



Written 



Committee for 
Programs in 
Secondary Schools 



DEC 



43.Endoffu'St BEPC 
cycle secondary 
(4) 



Certification Written 



44. End of first 
cycle secondary 
(4) 

45. End of second 
cycle secondary 
(3) 



Concours 



Baccalaureat 



46. End of secondary Concours 



Other 



CAPE VERDE 



Selection 



Certification 



NA 



Written and 
oral 



Selection for Written 
university 



DEC 



DEC 



DEC and 
Directorate of 
Third Level 
Education 

DEC 



47. End of basic 
complementary 
(2) 



Elementary cycle Certification, \ . u m, 
examination Selection C^ral 

(Exemption option) 



48. End of general General secondary Certification/ Written, 
secondary examination Selection Oral 

education (3) (Exemption option) 



National 
Examination 
Committee, 
Ministry of 
Education 

National 
Examination 
Committee, 
Ministry of 
Education 
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Appendix 2 (continued) 



When given 



Title 



Function 



Type 



Responsibility of 



49. End of 

complementary 
secondary 
education (2) 



Diploma of Upper Certification/ Written, 
Secondary Educ. Selection Oral, 
(Exemption option) Practical 



National 
Examination 
Committee, 
Ministry of 
Education 



ETHIOPIA 



50. End of primary 



51. End of Grade 8: 
(2 years - first 
cycle) 



Grade 6 National 
Examination 



Grade 8 National 
Examination 



Certification/ 
Selection 



Certification/ 
Selection 



Multiple- 
choice, 
School- 
based 
component 

Multiple- 
choice 



National 
Examination 
Board, Ministry 
of Education 



NEB, Ministry of 
Education 



52. End of Grade 12: ESLCE Certification/ Multiple- University of 

(4 years - second Selection choice Addis Ababa 

cycle) (Essay 

up to 1977) 
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Appendix 3 



Kenya Certificate of Primary Education: 
Sample Essay and Marker*s Comments 



That evening my father came home looking 
unusually happy. He told me he had some- 
thing to tell us, but before he could do that, he 
asked me to go and call Heri. When we both 
came in we found that everyone else was 
waiting for the two of us. My father as usual 
was seated on his armchair with a cigarette in 
his mouth. My mother was standing by him 
and my two other sisters were seated at the 
dining table. We all had an idea of what the 
good news was but we were unsure. 

When everybody had seated down, my fa- 
ther began talking. There was suddenly a cry 
of joy and everbody came rushing towards 
me. It was so sudden that I almost fell off my 
seat. Everybody was hugging me and doing 
all sorts of funny things. I just could not 
believe my eyes. What I had been waiting for 
so anxiously was now revealed. It was too 
good to be true. I do not know how I made it, 
but passing my examination was the best 
news I had ever heard. None of us could 
control ourselves. Some of us almost jv aped 
high enough to touch the ceiling with our 
heads. All that was ringing in my head was 
that I had passed with flying colours and to 
which school I would be chosen to go. 

My father asked everyone to be silent since he 
had not finished saying what he wanted. 



Once resettled, he told us that I was among 
the top people in the school and that I would 
get an award for that. He also told us that he 
was to go and check which school had chosen 
me to be one of their student.,. I was overjoyed 
in such a way that I could hardly move from 
where I was now seated. I could just remem- 
ber the way I was so nervous while doing the 
exams and all the words of good luck from 
my friends and relatives. I was glad that all 
the messages in the cards had been fulfilled 
and also the fact that I did not disappoint my 
parents. This had happened before with Heri, 
but I had challenged him and beaten him. I 
could remember all the promises made to me 
by my uncles and aunts and I felt as though 
my heart v/as smiling inside. 

After having supper that ii .ght, I v/as called to 
my parent's room and as' ed what I wanted to 
have as a preseni. I named almost everything 
one could think of and this made r^'^ern laugh 
since they knew the situation I v/as in and in 
which they had also gone through. Since they 
could not buy me everything, I war romised 
the most essential things. I would never for- 
get that day because it was the happiest day of 
my life and having that feeling inside me 
makes me feel that in future I will also do well 



Ma:f k Awarded: 37 
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Marker's Comments: 



Although this piece of writing was not the 
very best, it did represent that top quality 
writing which is not very easy to come by. 
Candidates who reached this standard were 
actually very few. Except for such errors as 
the usage of 'seated' instead of the simple past 
'saf and such flaws as 'after having supper 
that aighf — a candidate as this would even 
have scored higher marks had he been more 
interesting and had he used a greater variety 
of structures in his writing. 

From the brief analysis of errors in the com- 
positions included in this newsletter and in 
other compositions written by candidates in 
1985 KCPE we discovered that certain kinds 
of errors were being made repeatedly. Incor- 
rect verb tenses, wrong usage of words, spell- 
ing errors and errors in syntax were wide- 
spread. 



Examples: 

Incorrect verb tenses: 

We all sit down and listen to him. (We all sat 
down and listened to him.) 

My father did not agreed. (My father did not 
agree.) 

They took the money and leave him crying. 
(They took the money and left him crying.) 

Mumerous similar errors were made by can- 
didates. 

Source: Kenya National Examinations Coun- 
cil (1986) 
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